[ 522.416394] env[66640]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.416394] env[66640]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 523.426372] env[66730]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 523.426372] env[66730]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 525.010777] env[66730]: INFO neutron.common.config [-] Logging enabled! [ 525.011133] env[66730]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev9 [ 525.011702] env[66730]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66730) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 525.012152] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 525.012302] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 525.013218] env[66730]: WARNING oslo_policy.policy [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 525.013439] env[66730]: WARNING oslo_policy.policy [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 525.015144] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] VMware NSXv3 Agent initialized successfully. [ 525.015535] env[66730]: DEBUG oslo_concurrency.lockutils [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] Acquiring lock "singleton_lock" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.015650] env[66730]: DEBUG oslo_concurrency.lockutils [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] Acquired lock "singleton_lock" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.015857] env[66730]: DEBUG oslo_concurrency.lockutils [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] Releasing lock "singleton_lock" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.016204] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] Full set of CONF: {{(pid=66730) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 525.016381] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ******************************************************************************** {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 525.016511] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] Configuration options gathered from: {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 525.016892] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 525.017190] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 525.017296] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ================================================================================ {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 525.017553] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] agent_down_time = 75 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.017754] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] allow_automatic_dhcp_failover = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.017870] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] allow_bulk = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.018116] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] api_extensions_path = {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.018202] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] api_paste_config = api-paste.ini {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.018376] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] auth_strategy = keystone {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.018427] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] backdoor_port = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.018522] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] backdoor_socket = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.018686] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] backlog = 4096 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.018843] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] base_mac = fa:16:3e:00:00:00 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.018996] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] bind_host = 0.0.0.0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.019148] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] bind_port = 9696 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.019291] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] client_socket_timeout = 900 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.019414] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] config_dir = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.019523] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.019658] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] config_source = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.019793] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] control_exchange = neutron {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.019962] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] core_plugin = ml2 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.020124] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] debug = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.020253] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] default_availability_zones = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.020466] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.020595] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] dhcp_agent_notification = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.020723] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] dhcp_agents_per_network = 1 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.020851] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] dhcp_lease_duration = 86400 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.021020] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] dhcp_load_type = networks {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.021142] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] dns_domain = openstacklocal {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.021280] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.021381] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] enable_default_route_bfd = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.021534] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] enable_default_route_ecmp = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.021685] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] enable_dvr = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.021814] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] enable_new_agents = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.021961] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.022112] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] enable_signals = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.022244] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] enable_traditional_dhcp = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.022368] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] external_dns_driver = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.022499] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] filter_validation = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.022641] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] global_physnet_mtu = 8950 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.022770] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] graceful_shutdown_timeout = 60 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.022957] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] host = cpu-1 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.023108] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] host_dvr_for_dhcp = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.023245] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] http_retries = 3 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.023403] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] instance_format = [instance: %(uuid)s] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.023527] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.023647] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ipam_driver = internal {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.023755] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ipv6_pd_enabled = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.023885] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] l3_ha = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.024029] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.024201] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] l3_ha_network_physical_name = {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.024338] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] l3_ha_network_type = {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.024474] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] log_color = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.024642] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] log_config_append = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.024783] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.024912] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] log_dir = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.025052] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] log_file = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.025153] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] log_options = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.025287] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] log_rotate_interval = 1 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.025422] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] log_rotate_interval_type = days {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.025587] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] log_rotation_type = none {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.025689] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.025788] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.026024] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.026133] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.026217] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.026387] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] max_dns_nameservers = 5 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.026510] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] max_header_line = 16384 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.026702] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] max_l3_agents_per_router = 3 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.026872] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] max_logfile_count = 30 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.027021] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] max_logfile_size_mb = 200 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.027198] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] max_subnet_host_routes = 20 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.027344] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] my_ip = 10.180.1.21 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.027480] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] my_ipv6 = ::1 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.027612] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] network_auto_schedule = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.027736] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] network_link_prefix = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.027868] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.028035] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] notify_nova_on_port_data_changes = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.028256] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] notify_nova_on_port_status_changes = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.028547] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] pagination_max_limit = -1 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.028672] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] publish_errors = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.028895] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] rate_limit_burst = 0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.029089] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] rate_limit_except_level = CRITICAL {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.029260] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] rate_limit_interval = 0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.029426] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] retry_until_window = 30 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.029568] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] router_distributed = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.029741] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] rpc_resources_processing_step = 20 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.029885] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] rpc_response_max_timeout = 600 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.030089] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] rpc_response_timeout = 60 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.030237] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] send_events_interval = 2 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.030455] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] service_plugins = ['router'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.030611] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] setproctitle = on {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.030743] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] shell_completion = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.030931] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] state_path = /opt/stack/data/neutron {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.031105] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] syslog_log_facility = LOG_USER {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.031266] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] tcp_keepidle = 600 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.031413] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] transport_url = **** {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.031547] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] use_journal = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.031708] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] use_json = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.031923] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] use_ssl = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.031993] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] use_stderr = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.032147] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] use_syslog = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.032239] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] vlan_qinq = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.032356] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] vlan_transparent = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.032483] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] watch_log_file = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.032613] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] wsgi_default_pool_size = 100 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.032740] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] wsgi_keep_alive = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.032875] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.033042] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] wsgi_server_debug = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.033266] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_concurrency.disable_process_locking = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.033454] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.033602] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.033737] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.033876] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.034047] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.034185] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.034334] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.connection_string = messaging:// {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.034471] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.enabled = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.034608] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.es_doc_type = notification {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.034743] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.es_scroll_size = 10000 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.034877] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.es_scroll_time = 2m {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.035014] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.filter_error_trace = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.035153] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.hmac_keys = **** {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.035287] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.sentinel_service_name = mymaster {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.035427] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.socket_timeout = 0.1 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.035589] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.trace_requests = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.035732] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler.trace_sqlalchemy = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.035883] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler_jaeger.process_tags = {} {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.036058] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler_jaeger.service_name_prefix = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.036211] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] profiler_otlp.service_name_prefix = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.036362] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.enforce_new_defaults = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.036686] env[66730]: WARNING oslo_config.cfg [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 525.036842] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.enforce_scope = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.037020] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.policy_default_rule = default {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.037177] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.037318] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.037458] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.037588] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.037746] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.037899] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.038051] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.038223] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_policy.remote_timeout = 60.0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.038388] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.038562] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] agent.extensions = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.038730] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.038857] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] service_providers.service_provider = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.039063] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.default_quota = -1 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.039218] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.039353] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.quota_floatingip = 50 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.039487] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.quota_network = 100 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.039623] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.quota_port = 500 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.039801] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.039942] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.quota_router = 10 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.040124] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.quota_security_group = 10 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.040271] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.040402] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.quota_subnet = 100 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.040533] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] QUOTAS.track_quota_usage = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.040679] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.040807] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep.group = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.040934] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep.helper_command = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.041076] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep.log_daemon_traceback = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.041263] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.041335] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep.thread_pool_size = 8 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.041463] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep.user = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.041601] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.041756] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_dhcp_release.group = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.041918] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_dhcp_release.helper_command = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.042065] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.042202] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.042332] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.042459] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_dhcp_release.user = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.042596] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.042722] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_ovs_vsctl.group = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.042845] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_ovs_vsctl.helper_command = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.042972] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.043182] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.043352] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.043432] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_ovs_vsctl.user = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.043644] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_namespace.capabilities = [21] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.043779] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_namespace.group = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.043883] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_namespace.helper_command = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.044035] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_namespace.log_daemon_traceback = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.044175] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.044305] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_namespace.thread_pool_size = 8 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.044469] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_namespace.user = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.044574] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_conntrack.capabilities = [12] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.044693] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_conntrack.group = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.044869] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_conntrack.helper_command = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.045094] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.045234] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.045434] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.045636] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_conntrack.user = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.045795] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_link.capabilities = [12, 21] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.045978] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_link.group = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.046198] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_link.helper_command = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.046391] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_link.log_daemon_traceback = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.046550] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.046719] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_link.thread_pool_size = 8 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.046886] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] privsep_link.user = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.047135] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.047349] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.047505] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.continue_on_failed_promotions = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.047642] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.dscp = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.047778] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.dscp_inherit = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.047966] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.force_mp_to_policy = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.048172] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.locking_coordinator_url = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.048366] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.log_agent_heartbeats = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.048555] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.logging_expire = 1 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.048874] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.048959] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.049124] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.polling_interval = 240 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.049352] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.049570] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.049808] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.report_interval = 30.0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.050065] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.050325] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.050540] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.050766] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.sync_skew = 60 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.050945] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.synchronization_queue_size = 20 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.051104] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT.use_helper_for_ns_read = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.051254] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] SECURITYGROUP.enable_ipset = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.051453] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] SECURITYGROUP.enable_security_group = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.051666] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.051900] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.052118] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] experimental.ipv6_pd_enabled = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.052360] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ml2.extension_drivers = ['port_security'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.052556] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ml2.external_network_type = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.052763] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.052964] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ml2.overlay_ip_version = 4 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.053186] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ml2.path_mtu = 8950 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.053378] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ml2.physical_network_mtus = {} {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.053555] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ml2.tenant_network_types = ['vlan'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.053706] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.053904] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ml2.type_drivers = ['vlan'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.054100] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT_CLI.neutron_port_id = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.054248] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.054383] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.054528] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.054672] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.054810] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.054947] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.055104] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.055236] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.055442] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.055645] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_login_password = **** {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.055805] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_login_port = 443 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.055949] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_login_user = admin {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.056100] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.056242] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.056375] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.056519] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.056651] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.056797] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.056929] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.057080] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.057214] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.057348] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.057488] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.057620] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.057751] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.057952] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.058104] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] vsphere.vsphere_login_password = VMware1! {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.058242] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.058369] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.058504] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.auth_section = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.058645] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.auth_type = password {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.059176] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.059176] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.certfile = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.059176] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.collect_timing = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.059176] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.endpoint_type = public {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.059331] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.insecure = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.059539] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.keyfile = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.059539] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.region_name = RegionOne {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.059712] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.split_loggers = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.059779] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] nova.timeout = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.059899] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.auth_section = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.060042] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.auth_type = password {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.060180] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.060308] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.certfile = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.060434] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.collect_timing = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.060569] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.endpoint_type = public {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.060698] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.insecure = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.060820] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.keyfile = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.060943] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.region_name = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.061079] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.split_loggers = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.061206] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] placement.timeout = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.061335] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.auth_section = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.061463] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.auth_type = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.061585] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.cafile = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.061723] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.certfile = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.061916] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.collect_timing = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.062071] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.connect_retries = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.062201] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.connect_retry_delay = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.062332] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.enable_notifications = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.062459] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.endpoint_override = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.062583] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.insecure = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.062709] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.interface = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.062830] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.keyfile = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.062958] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.max_version = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.063094] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.min_version = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.063216] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.region_name = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.063339] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.retriable_status_codes = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.063463] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.service_name = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.063622] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.service_type = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.063755] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.split_loggers = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.063880] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.status_code_retries = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.064054] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.status_code_retry_delay = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.064205] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.timeout = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.064334] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.valid_interfaces = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.064459] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ironic.version = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.064595] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] cli_script.dry_run = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.064741] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.064873] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.065008] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.065145] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.065272] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.065404] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.065560] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.065703] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.065834] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.065972] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.066112] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.066250] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.066384] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.066518] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.066647] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.066781] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.066911] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.067049] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.067188] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.067317] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.067444] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.067570] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.067732] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.067869] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.068048] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.068182] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.068312] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.068441] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.068571] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.068706] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.068836] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.ssl = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.068977] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.069155] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.069294] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.069431] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.069677] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.ssl_version = {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.069730] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.069839] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_notifications.driver = [] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.069967] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_notifications.retry = -1 {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.070123] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.070249] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] oslo_messaging_notifications.transport_url = **** {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.070360] env[66730]: DEBUG oslo_service.backend._eventlet.service [None req-2fa7fb5d-07fe-4907-889b-bc9803325f41 None None] ******************************************************************************** {{(pid=66730) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 525.071592] env[66730]: DEBUG neutron.agent.securitygroups_rpc [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Init firewall settings (driver=nsxv3) {{(pid=66730) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 525.072930] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66730) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 525.073197] env[66730]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] RPC agent_id: nsxm-l-01a.corp.local [ 525.075477] env[66730]: DEBUG dogpile.cache.region [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 525.075621] env[66730]: DEBUG dogpile.lock [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 525.075719] env[66730]: DEBUG dogpile.lock [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 525.075806] env[66730]: DEBUG dogpile.lock [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 525.075896] env[66730]: DEBUG dogpile.cache.region [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 525.075979] env[66730]: DEBUG dogpile.lock [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 525.076134] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 525.126409] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Session token - acquiring [ 525.128187] env[66730]: DEBUG networking_nsxv3.common.locking [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.128448] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.128448] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.128910] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.142054] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.431777] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 525.473202] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 525.473360] env[66730]: DEBUG dogpile.cache.region [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Cache value generated in 0.397 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 525.473412] env[66730]: DEBUG dogpile.lock [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 525.473538] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Activating Policy API Provider. [ 525.473754] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Looking for the default Infrastructure Rules. [ 525.574956] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Looking for the Default Layer3 Logged Drop Section. [ 525.597665] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 525.598125] env[66730]: DEBUG networking_nsxv3.common.locking [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.598288] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquiring lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.598383] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.598667] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired external semaphore "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.599010] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.113244] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.615605] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.118295] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Inventory metadata is going to be refreshed. [ 527.118731] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 527.969883] env[66730]: DEBUG networking_nsxv3.common.locking [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.970173] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.970173] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.970503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.981961] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 527.982815] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.983466] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 528.003153] env[66730]: DEBUG networking_nsxv3.common.locking [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.003381] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.003444] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.003783] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.003913] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.004092] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 528.004229] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.004342] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 528.025369] env[66730]: DEBUG networking_nsxv3.common.locking [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.025651] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.025707] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.025986] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.026175] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.026327] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 528.047804] env[66730]: DEBUG networking_nsxv3.common.locking [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.048063] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.048112] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.048394] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.048535] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.048681] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 528.071015] env[66730]: DEBUG networking_nsxv3.common.locking [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.071232] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquiring lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.071312] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.071576] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired external semaphore "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.071709] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Releasing lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.071855] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 528.071957] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.072068] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 528.091382] env[66730]: DEBUG networking_nsxv3.common.locking [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.091608] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquiring lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.091660] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.091922] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired external semaphore "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.092057] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Releasing lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.092197] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 528.092296] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.092396] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 528.115754] env[66730]: DEBUG networking_nsxv3.common.locking [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.115981] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.116037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.116323] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.116457] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.116604] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 528.116879] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.117011] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Inventory metadata have been refreshed. [ 528.117123] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Dryrun:True. Metadata refresh completed. [ 528.117247] env[66730]: DEBUG oslo_concurrency.lockutils [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Releasing lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.118875] env[66730]: INFO neutron.agent.agent_extensions_manager [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Loaded agent extensions: [] [ 528.119589] env[66730]: DEBUG neutron_lib.callbacks.manager [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66730) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 528.173785] env[66730]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] NSXv3 Agent Agent RPC Daemon Started! [ 528.173967] env[66730]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] NSXv3 Agent Agent loop - iteration:0 started [ 528.174105] env[66730]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] NSXv3 Agent Agent out of sync with plugin! [ 533.120601] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 533.120927] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 538.122273] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 538.122666] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.863203] env[66730]: INFO networking_nsxv3.common.synchronization [None req-c64653f0-8dda-4f13-916b-a054f5936590 demo admin] Enqueued Resource ID: 62f9dfba-b80f-41ca-b2bf-23d0b489d025 with Priority: HIGHEST for action security_group_rules [ 542.863458] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f9dfba-b80f-41ca-b2bf-23d0b489d025 with Priority: HIGHEST for action security_group_rules [ 542.863792] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62f9dfba-b80f-41ca-b2bf-23d0b489d025 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.863792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62f9dfba-b80f-41ca-b2bf-23d0b489d025" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.863971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62f9dfba-b80f-41ca-b2bf-23d0b489d025" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.864225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62f9dfba-b80f-41ca-b2bf-23d0b489d025" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.864438] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62f9dfba-b80f-41ca-b2bf-23d0b489d025',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.388041] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.388041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.388041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.388041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.388041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.388041] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62f9dfba-b80f-41ca-b2bf-23d0b489d025 already deleted. [ 543.388041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62f9dfba-b80f-41ca-b2bf-23d0b489d025" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.122070] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.122465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.122465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.122465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.122675] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.625125] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.127680] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.630473] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 546.630473] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 547.334786] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.335287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.335287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.335287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.346970] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 547.347745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.348344] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 547.376249] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.376530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.376530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.376660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.376784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.376915] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 547.376991] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.377070] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 547.396532] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.396751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.396751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.396930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.397118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.397233] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 547.415602] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.415777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.415777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.416020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.416121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.416227] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 547.435137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.435341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.435341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.435520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.435621] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.435734] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 547.435806] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.435875] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 547.452336] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.452531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.452531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.452713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.452797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.452902] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 547.452974] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.453055] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 547.476742] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.477057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.477057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.477216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.477296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.477419] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 547.477494] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.477557] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 547.477621] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 547.477692] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 547.477748] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 547.477825] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 547.478162] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 547.478246] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 547.478326] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 547.498974] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.499226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.499226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.499386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.499489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.499595] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 547.518303] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.518518] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.518518] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.518700] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.518800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.553582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.864411] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 547.864618] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 552.865408] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.865801] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.867023] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.867457] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.868405] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.868879] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.869928] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.870255] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.401060] env[66730]: INFO networking_nsxv3.common.synchronization [None req-8170d602-ab51-4264-a76f-a03b0b82f91b None None] Enqueued Resource ID: 2f9c12e3-2b51-40ec-91f5-970e80f14743 with Priority: HIGHEST for action port [ 568.401798] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f9c12e3-2b51-40ec-91f5-970e80f14743 with Priority: HIGHEST for action port [ 568.402142] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f9c12e3-2b51-40ec-91f5-970e80f14743 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.402321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f9c12e3-2b51-40ec-91f5-970e80f14743" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.402321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f9c12e3-2b51-40ec-91f5-970e80f14743" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.402809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f9c12e3-2b51-40ec-91f5-970e80f14743" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.402809] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f9c12e3-2b51-40ec-91f5-970e80f14743',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.904763] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f9c12e3-2b51-40ec-91f5-970e80f14743 [ 568.905055] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.905208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.905208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.905553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.905553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.905647] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f9c12e3-2b51-40ec-91f5-970e80f14743 already deleted. [ 568.905729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f9c12e3-2b51-40ec-91f5-970e80f14743" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.217178] env[66730]: INFO networking_nsxv3.common.synchronization [None req-79737407-d6e6-40f3-ac2b-f94d2211a1db None None] Enqueued Resource ID: f22187e0-9c53-441f-b0ea-f45a96a19877 with Priority: HIGHEST for action port [ 570.217902] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22187e0-9c53-441f-b0ea-f45a96a19877 with Priority: HIGHEST for action port [ 570.218502] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-f22187e0-9c53-441f-b0ea-f45a96a19877 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.218611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f22187e0-9c53-441f-b0ea-f45a96a19877" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.218742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f22187e0-9c53-441f-b0ea-f45a96a19877" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.218935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f22187e0-9c53-441f-b0ea-f45a96a19877" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.219041] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f22187e0-9c53-441f-b0ea-f45a96a19877',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.721861] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f22187e0-9c53-441f-b0ea-f45a96a19877 [ 570.721861] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.721861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.721861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.721861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.721861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.722065] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f22187e0-9c53-441f-b0ea-f45a96a19877 already deleted. [ 570.722065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f22187e0-9c53-441f-b0ea-f45a96a19877" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.946584] env[66730]: INFO networking_nsxv3.common.synchronization [None req-03a1c245-bc58-453e-bcb5-e3984c97f4cb None None] Enqueued Resource ID: 021c1b0c-4071-4c33-9148-32c88485281d with Priority: HIGHEST for action port [ 571.947112] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 021c1b0c-4071-4c33-9148-32c88485281d with Priority: HIGHEST for action port [ 571.947498] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-021c1b0c-4071-4c33-9148-32c88485281d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.947584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-021c1b0c-4071-4c33-9148-32c88485281d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.947621] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-021c1b0c-4071-4c33-9148-32c88485281d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.947841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-021c1b0c-4071-4c33-9148-32c88485281d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.947931] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('021c1b0c-4071-4c33-9148-32c88485281d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.450391] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 021c1b0c-4071-4c33-9148-32c88485281d [ 572.450622] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.450756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.450825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.451058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.451149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.451245] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:021c1b0c-4071-4c33-9148-32c88485281d already deleted. [ 572.451324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-021c1b0c-4071-4c33-9148-32c88485281d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.917484] env[66730]: INFO networking_nsxv3.common.synchronization [None req-678129c9-642c-4e3c-b7c2-302812744f0f None None] Enqueued Resource ID: 927f6832-d55c-46d6-925d-61406d0e7345 with Priority: HIGHEST for action port [ 573.917782] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927f6832-d55c-46d6-925d-61406d0e7345 with Priority: HIGHEST for action port [ 573.919965] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-927f6832-d55c-46d6-925d-61406d0e7345 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.919965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-927f6832-d55c-46d6-925d-61406d0e7345" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.919965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-927f6832-d55c-46d6-925d-61406d0e7345" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.919965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-927f6832-d55c-46d6-925d-61406d0e7345" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.919965] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('927f6832-d55c-46d6-925d-61406d0e7345',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.923476] env[66730]: INFO networking_nsxv3.common.synchronization [None req-98e4c04c-2991-4f38-a619-02ed1266f3e0 None None] Enqueued Resource ID: e454d380-dfc3-4bc2-8b49-c69b7675f0a4 with Priority: HIGHEST for action port [ 573.923661] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e454d380-dfc3-4bc2-8b49-c69b7675f0a4 with Priority: HIGHEST for action port [ 573.923921] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e454d380-dfc3-4bc2-8b49-c69b7675f0a4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.924041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e454d380-dfc3-4bc2-8b49-c69b7675f0a4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.924460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e454d380-dfc3-4bc2-8b49-c69b7675f0a4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.924460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e454d380-dfc3-4bc2-8b49-c69b7675f0a4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.924460] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e454d380-dfc3-4bc2-8b49-c69b7675f0a4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.423460] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 927f6832-d55c-46d6-925d-61406d0e7345 [ 574.423460] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.423460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.423460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.423460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.423460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.423460] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:927f6832-d55c-46d6-925d-61406d0e7345 already deleted. [ 574.423460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-927f6832-d55c-46d6-925d-61406d0e7345" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.427315] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e454d380-dfc3-4bc2-8b49-c69b7675f0a4 [ 574.427556] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.427679] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.427744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.427949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.428065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.428159] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e454d380-dfc3-4bc2-8b49-c69b7675f0a4 already deleted. [ 574.428266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e454d380-dfc3-4bc2-8b49-c69b7675f0a4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.828923] env[66730]: INFO networking_nsxv3.common.synchronization [None req-70e3e6f0-5431-4134-ac82-a670080674d7 None None] Enqueued Resource ID: d4649952-7366-4108-bf7b-7d860d109319 with Priority: HIGHEST for action port [ 575.829209] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4649952-7366-4108-bf7b-7d860d109319 with Priority: HIGHEST for action port [ 575.830133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4649952-7366-4108-bf7b-7d860d109319 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.830316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4649952-7366-4108-bf7b-7d860d109319" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.830316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4649952-7366-4108-bf7b-7d860d109319" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.830588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4649952-7366-4108-bf7b-7d860d109319" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.830703] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4649952-7366-4108-bf7b-7d860d109319',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.191500] env[66730]: INFO networking_nsxv3.common.synchronization [None req-3ee99cd5-c8f8-445c-a129-8d20c438581d None None] Enqueued Resource ID: 29515d80-11bd-4df5-86af-a09b9b6de5da with Priority: HIGHEST for action port [ 576.192562] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29515d80-11bd-4df5-86af-a09b9b6de5da with Priority: HIGHEST for action port [ 576.195322] env[66730]: INFO networking_nsxv3.common.synchronization [None req-415ff43f-881b-47c6-aee2-d9f8140d0bf5 None None] Enqueued Resource ID: 903ba31c-b224-400e-bbeb-08f92e973ebc with Priority: HIGHEST for action port [ 576.195322] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-29515d80-11bd-4df5-86af-a09b9b6de5da taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.195322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29515d80-11bd-4df5-86af-a09b9b6de5da" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.195322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29515d80-11bd-4df5-86af-a09b9b6de5da" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.195322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29515d80-11bd-4df5-86af-a09b9b6de5da" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.195322] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29515d80-11bd-4df5-86af-a09b9b6de5da',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.196497] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 903ba31c-b224-400e-bbeb-08f92e973ebc with Priority: HIGHEST for action port [ 576.196497] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-903ba31c-b224-400e-bbeb-08f92e973ebc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.196497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-903ba31c-b224-400e-bbeb-08f92e973ebc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.197328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-903ba31c-b224-400e-bbeb-08f92e973ebc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.197328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-903ba31c-b224-400e-bbeb-08f92e973ebc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.197328] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('903ba31c-b224-400e-bbeb-08f92e973ebc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.332762] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4649952-7366-4108-bf7b-7d860d109319 [ 576.333025] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.333362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.333362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.333440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.333529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.333612] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4649952-7366-4108-bf7b-7d860d109319 already deleted. [ 576.333729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4649952-7366-4108-bf7b-7d860d109319" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.696792] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29515d80-11bd-4df5-86af-a09b9b6de5da [ 576.697043] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.697183] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.697270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.697500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.697585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.698796] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29515d80-11bd-4df5-86af-a09b9b6de5da already deleted. [ 576.698796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29515d80-11bd-4df5-86af-a09b9b6de5da" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.698796] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 903ba31c-b224-400e-bbeb-08f92e973ebc [ 576.698796] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.698796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.698796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.698796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.698796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.698796] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:903ba31c-b224-400e-bbeb-08f92e973ebc already deleted. [ 576.698796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-903ba31c-b224-400e-bbeb-08f92e973ebc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.206215] env[66730]: INFO networking_nsxv3.common.synchronization [None req-e9b2cd7b-fc1b-4e60-b04b-4cde63853ed4 None None] Enqueued Resource ID: 533327a7-9e91-4ab7-8837-53b93db69c60 with Priority: HIGHEST for action port [ 577.207271] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 533327a7-9e91-4ab7-8837-53b93db69c60 with Priority: HIGHEST for action port [ 577.207716] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-533327a7-9e91-4ab7-8837-53b93db69c60 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.208075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-533327a7-9e91-4ab7-8837-53b93db69c60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.208245] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-533327a7-9e91-4ab7-8837-53b93db69c60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.208572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-533327a7-9e91-4ab7-8837-53b93db69c60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.208923] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('533327a7-9e91-4ab7-8837-53b93db69c60',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.712018] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 533327a7-9e91-4ab7-8837-53b93db69c60 [ 577.712177] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.712321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.712388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.712602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.712689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.712784] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:533327a7-9e91-4ab7-8837-53b93db69c60 already deleted. [ 577.712866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-533327a7-9e91-4ab7-8837-53b93db69c60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.000618] env[66730]: INFO networking_nsxv3.common.synchronization [None req-13c1f897-8bec-4a5d-88f7-4ec1b50f47be None None] Enqueued Resource ID: c0030eed-45bb-475c-9067-ac101a6b35e3 with Priority: HIGHEST for action port [ 579.000861] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0030eed-45bb-475c-9067-ac101a6b35e3 with Priority: HIGHEST for action port [ 579.001726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0030eed-45bb-475c-9067-ac101a6b35e3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.001726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0030eed-45bb-475c-9067-ac101a6b35e3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.001726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0030eed-45bb-475c-9067-ac101a6b35e3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.002757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0030eed-45bb-475c-9067-ac101a6b35e3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.002757] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0030eed-45bb-475c-9067-ac101a6b35e3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.117890] env[66730]: INFO networking_nsxv3.common.synchronization [None req-ccb91d94-4f4c-44db-b980-a20f95a1e88a None None] Enqueued Resource ID: b3ca4637-8d76-4977-97f9-dc42da03aa64 with Priority: HIGHEST for action port [ 579.117890] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3ca4637-8d76-4977-97f9-dc42da03aa64 with Priority: HIGHEST for action port [ 579.117890] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3ca4637-8d76-4977-97f9-dc42da03aa64 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.117890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3ca4637-8d76-4977-97f9-dc42da03aa64" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.117890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3ca4637-8d76-4977-97f9-dc42da03aa64" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.117890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3ca4637-8d76-4977-97f9-dc42da03aa64" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.117890] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3ca4637-8d76-4977-97f9-dc42da03aa64',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.507625] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0030eed-45bb-475c-9067-ac101a6b35e3 [ 579.507625] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.507860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.507860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.508101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.508192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.508307] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0030eed-45bb-475c-9067-ac101a6b35e3 already deleted. [ 579.508414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0030eed-45bb-475c-9067-ac101a6b35e3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.624188] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3ca4637-8d76-4977-97f9-dc42da03aa64 [ 579.624606] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.624752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.624817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.626062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.626062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.626062] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3ca4637-8d76-4977-97f9-dc42da03aa64 already deleted. [ 579.626062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3ca4637-8d76-4977-97f9-dc42da03aa64" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.642043] env[66730]: INFO networking_nsxv3.common.synchronization [None req-419d5de5-97ea-42b4-a28e-e9f2cb07ad47 None None] Enqueued Resource ID: 9d6a51fa-d243-4396-854d-5acbd7df4979 with Priority: HIGHEST for action port [ 579.642766] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d6a51fa-d243-4396-854d-5acbd7df4979 with Priority: HIGHEST for action port [ 579.642826] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d6a51fa-d243-4396-854d-5acbd7df4979 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.642937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d6a51fa-d243-4396-854d-5acbd7df4979" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.643169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d6a51fa-d243-4396-854d-5acbd7df4979" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.643727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d6a51fa-d243-4396-854d-5acbd7df4979" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.643727] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d6a51fa-d243-4396-854d-5acbd7df4979',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.147483] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d6a51fa-d243-4396-854d-5acbd7df4979 [ 580.147483] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.147483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.147483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.147483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.147483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.147989] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d6a51fa-d243-4396-854d-5acbd7df4979 already deleted. [ 580.147989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d6a51fa-d243-4396-854d-5acbd7df4979" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.175134] env[66730]: INFO networking_nsxv3.common.synchronization [None req-2f89d274-2ff2-45c6-bf50-b6d6cb7548cd None None] Enqueued Resource ID: 6a2e4852-5ac0-41ff-9403-5dc053bfe7cf with Priority: HIGHEST for action port [ 581.175982] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a2e4852-5ac0-41ff-9403-5dc053bfe7cf with Priority: HIGHEST for action port [ 581.176319] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a2e4852-5ac0-41ff-9403-5dc053bfe7cf taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.176499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a2e4852-5ac0-41ff-9403-5dc053bfe7cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.179953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a2e4852-5ac0-41ff-9403-5dc053bfe7cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.180248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a2e4852-5ac0-41ff-9403-5dc053bfe7cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.180346] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a2e4852-5ac0-41ff-9403-5dc053bfe7cf',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.682756] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a2e4852-5ac0-41ff-9403-5dc053bfe7cf [ 581.682756] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.682950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.682950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.683195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.685204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.685204] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a2e4852-5ac0-41ff-9403-5dc053bfe7cf already deleted. [ 581.685204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a2e4852-5ac0-41ff-9403-5dc053bfe7cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.114974] env[66730]: INFO networking_nsxv3.common.synchronization [None req-2ddaeeda-bb10-4d2b-9838-b7a68bb3c049 None None] Enqueued Resource ID: 011ed410-1625-421a-bf23-4c6612601df4 with Priority: HIGHEST for action port [ 582.115541] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 011ed410-1625-421a-bf23-4c6612601df4 with Priority: HIGHEST for action port [ 582.115831] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-011ed410-1625-421a-bf23-4c6612601df4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.115956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-011ed410-1625-421a-bf23-4c6612601df4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.116036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-011ed410-1625-421a-bf23-4c6612601df4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.116278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-011ed410-1625-421a-bf23-4c6612601df4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.116355] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('011ed410-1625-421a-bf23-4c6612601df4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.618157] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 011ed410-1625-421a-bf23-4c6612601df4 [ 582.618450] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.618517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.618624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.618791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.618873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.618966] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:011ed410-1625-421a-bf23-4c6612601df4 already deleted. [ 582.619051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-011ed410-1625-421a-bf23-4c6612601df4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.796699] env[66730]: INFO networking_nsxv3.common.synchronization [None req-0c7b564b-a5ee-474e-8d88-b3d445411e3a None None] Enqueued Resource ID: 9f34bc3d-da19-44f9-af30-b9395c83087f with Priority: HIGHEST for action port [ 582.797375] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f34bc3d-da19-44f9-af30-b9395c83087f with Priority: HIGHEST for action port [ 582.797714] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f34bc3d-da19-44f9-af30-b9395c83087f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.797843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f34bc3d-da19-44f9-af30-b9395c83087f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.797908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f34bc3d-da19-44f9-af30-b9395c83087f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.798571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f34bc3d-da19-44f9-af30-b9395c83087f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.798571] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f34bc3d-da19-44f9-af30-b9395c83087f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.931899] env[66730]: INFO networking_nsxv3.common.synchronization [req-a81f9578-8a88-4d2d-baff-1fcdaf86dd86 req-4233cec5-aa6c-4b8e-940f-f23cae9fe936 tempest-ImagesOneServerNegativeTestJSON-160835856 tempest-ImagesOneServerNegativeTestJSON-160835856-project-member] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 582.931899] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 582.931899] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.934214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.934214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.934214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.934214] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.934214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.934214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.934214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.934214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.934510] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.032206] env[66730]: INFO networking_nsxv3.common.synchronization [None req-0e5d2405-e2f9-42c2-a8c4-b12fca8edfec None None] Enqueued Resource ID: a60f701c-432d-4ee4-bf94-f771403e969e with Priority: HIGHEST for action port [ 583.032760] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a60f701c-432d-4ee4-bf94-f771403e969e with Priority: HIGHEST for action port [ 583.036651] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-a60f701c-432d-4ee4-bf94-f771403e969e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.037424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a60f701c-432d-4ee4-bf94-f771403e969e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.037424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a60f701c-432d-4ee4-bf94-f771403e969e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.037424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a60f701c-432d-4ee4-bf94-f771403e969e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.037424] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a60f701c-432d-4ee4-bf94-f771403e969e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.302162] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f34bc3d-da19-44f9-af30-b9395c83087f [ 583.302426] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.302591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.302683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.302960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.303081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.303184] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f34bc3d-da19-44f9-af30-b9395c83087f already deleted. [ 583.303269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f34bc3d-da19-44f9-af30-b9395c83087f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.437170] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.437349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.437432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.437755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.437854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.438068] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.438672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.438672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.438672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.438672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.438672] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a already deleted. [ 583.438868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.541299] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a60f701c-432d-4ee4-bf94-f771403e969e [ 583.541532] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.541933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.541933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.542013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.542377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.542377] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a60f701c-432d-4ee4-bf94-f771403e969e already deleted. [ 583.542377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a60f701c-432d-4ee4-bf94-f771403e969e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.859731] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.860051] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.861099] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.861483] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.861826] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.861934] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.866029] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.866029] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.866029] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.866029] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.866029] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 583.866029] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 583.866029] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 583.866029] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.866029] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 583.866029] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 583.885354] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 583.885467] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 583.885575] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 583.885754] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.886057] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-3ba7803f-e502-4353-8490-c569c3121565 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.886331] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-3ba7803f-e502-4353-8490-c569c3121565" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.886331] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-3ba7803f-e502-4353-8490-c569c3121565" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.886756] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-3ba7803f-e502-4353-8490-c569c3121565" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.886867] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ba7803f-e502-4353-8490-c569c3121565',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.389326] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.389533] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.392961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.392961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.392961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.392961] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 3ba7803f-e502-4353-8490-c569c3121565 not found, creating... [ 584.392961] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.392961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.392961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.392961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.392961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.392961] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.393431] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.393431] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.393431] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.393431] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.393431] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 3ba7803f-e502-4353-8490-c569c3121565 is going to be created. [ 584.436487] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.436771] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.436892] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.437552] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.438563] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.438563] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-3ba7803f-e502-4353-8490-c569c3121565" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.109840] env[66730]: INFO networking_nsxv3.common.synchronization [None req-d2ac226d-a4dc-47b4-8d58-47c3d3839b85 None None] Enqueued Resource ID: f8a8f60b-cf5e-4965-8696-15009174b9ca with Priority: HIGHEST for action port [ 585.110129] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8a8f60b-cf5e-4965-8696-15009174b9ca with Priority: HIGHEST for action port [ 585.110773] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8a8f60b-cf5e-4965-8696-15009174b9ca taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.110937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8a8f60b-cf5e-4965-8696-15009174b9ca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.110937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8a8f60b-cf5e-4965-8696-15009174b9ca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.111717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8a8f60b-cf5e-4965-8696-15009174b9ca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.112706] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8a8f60b-cf5e-4965-8696-15009174b9ca',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.214075] env[66730]: INFO networking_nsxv3.common.synchronization [req-a81f9578-8a88-4d2d-baff-1fcdaf86dd86 req-d6f1953e-c098-4848-9186-017333f3d121 service nova] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_rules [ 585.214364] env[66730]: INFO networking_nsxv3.common.synchronization [req-a81f9578-8a88-4d2d-baff-1fcdaf86dd86 req-d6f1953e-c098-4848-9186-017333f3d121 service nova] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 585.214364] env[66730]: INFO networking_nsxv3.common.synchronization [req-a81f9578-8a88-4d2d-baff-1fcdaf86dd86 req-d6f1953e-c098-4848-9186-017333f3d121 service nova] Enqueued Resource ID: 3ba7803f-e502-4353-8490-c569c3121565 with Priority: HIGHEST for action port [ 585.214867] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_rules [ 585.214999] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 585.215114] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba7803f-e502-4353-8490-c569c3121565 with Priority: HIGHEST for action port [ 585.215380] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.215550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.215550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.217458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.217633] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.218667] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.218799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.218901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.219070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.219219] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.219314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.219379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.219528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.219649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.220314] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.221276] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ba7803f-e502-4353-8490-c569c3121565 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.221276] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ba7803f-e502-4353-8490-c569c3121565" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.221405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ba7803f-e502-4353-8490-c569c3121565" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.221485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ba7803f-e502-4353-8490-c569c3121565" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.221551] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ba7803f-e502-4353-8490-c569c3121565',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.227326] env[66730]: INFO networking_nsxv3.common.synchronization [req-e2dc0d7a-3590-4e3e-864d-956c2bbe1605 req-6118ce79-9f99-4a15-bc15-308b78a204e6 tempest-InstanceActionsV221TestJSON-1274929290 tempest-InstanceActionsV221TestJSON-1274929290-project-member] Enqueued Resource ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 with Priority: HIGHEST for action security_group_members [ 585.227326] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 with Priority: HIGHEST for action security_group_members [ 585.228765] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.228884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.228936] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.229206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.229333] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.229510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.229510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.229625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.229728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.230269] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86bff83e-5f97-4faa-9dfa-26142c6b8cf5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.363802] env[66730]: INFO networking_nsxv3.common.synchronization [None req-b59601bf-f373-4554-8e7f-3e9cb6eda0bd None None] Enqueued Resource ID: 848be56e-d369-4dab-a1d1-b8572ad5e4b3 with Priority: HIGHEST for action port [ 585.364387] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848be56e-d369-4dab-a1d1-b8572ad5e4b3 with Priority: HIGHEST for action port [ 585.364631] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-848be56e-d369-4dab-a1d1-b8572ad5e4b3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.364763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-848be56e-d369-4dab-a1d1-b8572ad5e4b3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.364823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-848be56e-d369-4dab-a1d1-b8572ad5e4b3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.365351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-848be56e-d369-4dab-a1d1-b8572ad5e4b3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.365435] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('848be56e-d369-4dab-a1d1-b8572ad5e4b3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.613925] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8a8f60b-cf5e-4965-8696-15009174b9ca [ 585.614454] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.615444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.615444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.615444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.615444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.615444] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8a8f60b-cf5e-4965-8696-15009174b9ca already deleted. [ 585.615444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8a8f60b-cf5e-4965-8696-15009174b9ca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.723583] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.723708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.732383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.732516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.733123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.733123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.733123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.733123] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.733437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.733437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.733437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.733531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.733563] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 already deleted. [ 585.733977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.738094] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.740319] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ba7803f-e502-4353-8490-c569c3121565 with status ACTIVE [ 585.740539] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.741177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.741587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.741587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.741587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.741769] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.741870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.741930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.742084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.742159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.742334] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.742449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.742527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.742689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.742761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.742859] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ba7803f-e502-4353-8490-c569c3121565 is going to be updated. [ 585.766286] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.766480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.766613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.766828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.766992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.767192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ba7803f-e502-4353-8490-c569c3121565" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.794091] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-675 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.794183] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-675" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.794386] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-675" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.794837] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-675" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.795170] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.795335] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.795448] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.795734] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.795928] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.796421] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.796470] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.796681] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.796811] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.796811] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.798230] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.798413] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.823949] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.824111] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 585.824246] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.824417] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-675" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.824779] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-916e9145-d7a8-4b4a-a479-59e9e27f0d8a taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.825018] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-916e9145-d7a8-4b4a-a479-59e9e27f0d8a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.825184] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-916e9145-d7a8-4b4a-a479-59e9e27f0d8a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.825515] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-916e9145-d7a8-4b4a-a479-59e9e27f0d8a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.825653] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('916e9145-d7a8-4b4a-a479-59e9e27f0d8a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.867649] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 848be56e-d369-4dab-a1d1-b8572ad5e4b3 [ 585.867955] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.868164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.868333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.868877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.868994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.869366] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:848be56e-d369-4dab-a1d1-b8572ad5e4b3 already deleted. [ 585.869366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-848be56e-d369-4dab-a1d1-b8572ad5e4b3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.245851] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.330677] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.330974] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.331111] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.331396] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.331550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.331716] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 916e9145-d7a8-4b4a-a479-59e9e27f0d8a not found, creating... [ 586.331982] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.332152] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.332265] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.332480] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.332611] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.332885] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.333068] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.333156] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.333374] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.333551] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.333632] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 916e9145-d7a8-4b4a-a479-59e9e27f0d8a is going to be created. [ 586.354639] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.354855] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.355694] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.355694] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.355694] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.355892] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-916e9145-d7a8-4b4a-a479-59e9e27f0d8a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.750177] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.750309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.750397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.750541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.750620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.750714] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be created. [ 586.842141] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.842883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.843436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.843436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.843853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.860879] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7132f962-ac86-49d9-b409-47fe427b2ae9 None None] Enqueued Resource ID: 44475f6f-426c-4fee-bcf3-f7200d84b9d4 with Priority: HIGHEST for action port [ 586.860879] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: UNINITIALIZED for 2s [ 586.860879] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44475f6f-426c-4fee-bcf3-f7200d84b9d4 with Priority: HIGHEST for action port [ 586.861707] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-44475f6f-426c-4fee-bcf3-f7200d84b9d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.862093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44475f6f-426c-4fee-bcf3-f7200d84b9d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.862344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44475f6f-426c-4fee-bcf3-f7200d84b9d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.862940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44475f6f-426c-4fee-bcf3-f7200d84b9d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.863215] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44475f6f-426c-4fee-bcf3-f7200d84b9d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.185044] env[66730]: INFO networking_nsxv3.common.synchronization [req-e2dc0d7a-3590-4e3e-864d-956c2bbe1605 req-eec71b1b-24f1-436f-b016-2fe221e7111f service nova] Enqueued Resource ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 with Priority: HIGHEST for action security_group_rules [ 587.185044] env[66730]: INFO networking_nsxv3.common.synchronization [req-e2dc0d7a-3590-4e3e-864d-956c2bbe1605 req-eec71b1b-24f1-436f-b016-2fe221e7111f service nova] Enqueued Resource ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 with Priority: HIGHEST for action security_group_members [ 587.185044] env[66730]: INFO networking_nsxv3.common.synchronization [req-e2dc0d7a-3590-4e3e-864d-956c2bbe1605 req-eec71b1b-24f1-436f-b016-2fe221e7111f service nova] Enqueued Resource ID: 916e9145-d7a8-4b4a-a479-59e9e27f0d8a with Priority: HIGHEST for action port [ 587.185044] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 with Priority: HIGHEST for action security_group_rules [ 587.185044] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 with Priority: HIGHEST for action security_group_members [ 587.185044] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916e9145-d7a8-4b4a-a479-59e9e27f0d8a with Priority: HIGHEST for action port [ 587.185044] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86bff83e-5f97-4faa-9dfa-26142c6b8cf5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.189314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.189314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.189314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.189314] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86bff83e-5f97-4faa-9dfa-26142c6b8cf5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.189314] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.189314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.189314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.189679] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.189679] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.189794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.189834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.189966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.190056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.190143] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86bff83e-5f97-4faa-9dfa-26142c6b8cf5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.193523] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-916e9145-d7a8-4b4a-a479-59e9e27f0d8a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.193648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-916e9145-d7a8-4b4a-a479-59e9e27f0d8a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.193705] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-916e9145-d7a8-4b4a-a479-59e9e27f0d8a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.193858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-916e9145-d7a8-4b4a-a479-59e9e27f0d8a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.193961] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('916e9145-d7a8-4b4a-a479-59e9e27f0d8a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.365618] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44475f6f-426c-4fee-bcf3-f7200d84b9d4 [ 587.365932] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.366021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.366485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.366751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.366846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.366948] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44475f6f-426c-4fee-bcf3-f7200d84b9d4 already deleted. [ 587.367042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44475f6f-426c-4fee-bcf3-f7200d84b9d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.699019] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86bff83e-5f97-4faa-9dfa-26142c6b8cf5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.699019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.699019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.699019] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 916e9145-d7a8-4b4a-a479-59e9e27f0d8a with status ACTIVE [ 587.699019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.699019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.699019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.699019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.699019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.699019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.699019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.699019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.699019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.699019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.699620] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.699620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.699620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.699620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.699620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.700810] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 916e9145-d7a8-4b4a-a479-59e9e27f0d8a is going to be updated. [ 587.723776] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.723776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.723776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.723776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.723776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.724073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-916e9145-d7a8-4b4a-a479-59e9e27f0d8a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.197892] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86bff83e-5f97-4faa-9dfa-26142c6b8cf5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.700351] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.701118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.701118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.701118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.701118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.701118] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 is going to be created. [ 588.726105] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.726257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.726324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.726538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.726714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.736654] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 in Status: UNINITIALIZED for 2s [ 588.873655] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: SUCCESS [ 588.873893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.874074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.874608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.874726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.874883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.874970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.875186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.875274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.875466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.875466] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.957701] env[66730]: INFO networking_nsxv3.common.synchronization [None req-ed693bac-b60e-429b-bd54-50f88067c5e7 None None] Enqueued Resource ID: 9627e82d-4d9f-4237-ba92-e86aac1f4f29 with Priority: HIGHEST for action port [ 588.958198] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9627e82d-4d9f-4237-ba92-e86aac1f4f29 with Priority: HIGHEST for action port [ 588.960993] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9627e82d-4d9f-4237-ba92-e86aac1f4f29 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.961151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9627e82d-4d9f-4237-ba92-e86aac1f4f29" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.961211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9627e82d-4d9f-4237-ba92-e86aac1f4f29" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.961472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9627e82d-4d9f-4237-ba92-e86aac1f4f29" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.961558] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9627e82d-4d9f-4237-ba92-e86aac1f4f29',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.995800] env[66730]: INFO networking_nsxv3.common.synchronization [None req-108a520d-850c-4003-84b1-12ff2bc9e727 None None] Enqueued Resource ID: 9e1ed779-4763-42bf-8369-501bafca3248 with Priority: HIGHEST for action port [ 588.996058] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e1ed779-4763-42bf-8369-501bafca3248 with Priority: HIGHEST for action port [ 588.996569] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e1ed779-4763-42bf-8369-501bafca3248 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.996729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e1ed779-4763-42bf-8369-501bafca3248" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.996797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e1ed779-4763-42bf-8369-501bafca3248" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.997024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e1ed779-4763-42bf-8369-501bafca3248" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.997207] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e1ed779-4763-42bf-8369-501bafca3248',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.380985] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.380985] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.380985] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.380985] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.380985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.381507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.381507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.381507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.381507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.381507] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.465249] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9627e82d-4d9f-4237-ba92-e86aac1f4f29 [ 589.465879] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.465879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.465879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.466132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.466132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.466301] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9627e82d-4d9f-4237-ba92-e86aac1f4f29 already deleted. [ 589.466350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9627e82d-4d9f-4237-ba92-e86aac1f4f29" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.498862] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e1ed779-4763-42bf-8369-501bafca3248 [ 589.499154] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.499308] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.499380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.499592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.499681] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.499775] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e1ed779-4763-42bf-8369-501bafca3248 already deleted. [ 589.499858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e1ed779-4763-42bf-8369-501bafca3248" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.885961] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c63f5ef2-5b7c-4817-aa38-f459fffee01a: rpc.has_security_group_logging(os_id): False [ 589.905992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.906167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.906272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.906435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.906685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.907133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.907264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.907324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.907487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.907596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.908837] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.908973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.908973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.909112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.909188] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.909574] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.909574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.909574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.909781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.909781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.909781] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be created. [ 589.993618] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.993772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.993842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.994083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.994334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.011405] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: IN_PROGRESS for 2s [ 590.397575] env[66730]: INFO networking_nsxv3.common.synchronization [None req-9cae68ed-437d-4f90-a9a9-9be41e542d39 None None] Enqueued Resource ID: 5623ab79-0e18-43c5-a0db-abd7b9e71151 with Priority: HIGHEST for action port [ 590.398068] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5623ab79-0e18-43c5-a0db-abd7b9e71151 with Priority: HIGHEST for action port [ 590.398372] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-5623ab79-0e18-43c5-a0db-abd7b9e71151 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.398494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5623ab79-0e18-43c5-a0db-abd7b9e71151" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.398589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5623ab79-0e18-43c5-a0db-abd7b9e71151" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.398805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5623ab79-0e18-43c5-a0db-abd7b9e71151" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.399376] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5623ab79-0e18-43c5-a0db-abd7b9e71151',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.748714] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 in Status: SUCCESS [ 590.748934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.749166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.749349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.749536] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.749656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.749721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.749874] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.749954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.750088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.750138] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86bff83e-5f97-4faa-9dfa-26142c6b8cf5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.907437] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5623ab79-0e18-43c5-a0db-abd7b9e71151 [ 590.909943] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.909943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.909943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.909943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.909943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.909943] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5623ab79-0e18-43c5-a0db-abd7b9e71151 already deleted. [ 590.910195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5623ab79-0e18-43c5-a0db-abd7b9e71151" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.087397] env[66730]: INFO networking_nsxv3.common.synchronization [None req-aea01673-3881-4f67-8833-795e708d014e None None] Enqueued Resource ID: dc5b6f6d-987e-49e2-9ec6-be735c508c93 with Priority: HIGHEST for action port [ 591.087971] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5b6f6d-987e-49e2-9ec6-be735c508c93 with Priority: HIGHEST for action port [ 591.088284] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc5b6f6d-987e-49e2-9ec6-be735c508c93 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.088402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc5b6f6d-987e-49e2-9ec6-be735c508c93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.088463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc5b6f6d-987e-49e2-9ec6-be735c508c93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.088707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc5b6f6d-987e-49e2-9ec6-be735c508c93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.088789] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5b6f6d-987e-49e2-9ec6-be735c508c93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.254796] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.254949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.255038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.255405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.255519] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.255519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.255651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.255749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.255833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.255917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.256075] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.256164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.256221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.256377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.256513] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.256650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.256704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.256833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.256919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.256985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.257085] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86bff83e-5f97-4faa-9dfa-26142c6b8cf5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.595010] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc5b6f6d-987e-49e2-9ec6-be735c508c93 [ 591.595010] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.595010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.595187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.596030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.596030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.596030] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc5b6f6d-987e-49e2-9ec6-be735c508c93 already deleted. [ 591.596030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc5b6f6d-987e-49e2-9ec6-be735c508c93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.762033] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86bff83e-5f97-4faa-9dfa-26142c6b8cf5: rpc.has_security_group_logging(os_id): False [ 591.783416] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.783550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.783593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.783800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.784472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.784472] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.784472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.784472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.784780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.784780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.784780] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.784961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.784961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.785078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.785130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.785274] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.785379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.785439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.785625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.785701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.785780] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 is going to be created. [ 591.812708] env[66730]: INFO networking_nsxv3.common.synchronization [req-db575d5f-8e78-40f3-9d42-e5a2e4226147 req-939c053d-dfd0-4187-9ef0-15381169a103 tempest-TenantUsagesTestJSON-1643601631 tempest-TenantUsagesTestJSON-1643601631-project-member] Enqueued Resource ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 with Priority: HIGHEST for action security_group_members [ 591.813813] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 with Priority: HIGHEST for action security_group_members [ 591.813813] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.813813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.813813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.813813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.814073] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.814139] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.814205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.814402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.814494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.814588] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ad5de68-7a54-4c50-932c-9a6fbf8463f4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.869842] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.869842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.869842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.869842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.869842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.882602] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 in Status: IN_PROGRESS for 2s [ 591.921192] env[66730]: INFO networking_nsxv3.common.synchronization [None req-abe8de7a-573a-45d1-bf1e-ca9155048d82 None None] Enqueued Resource ID: 7c28cd20-910a-4442-bf58-8986fca235ae with Priority: HIGHEST for action port [ 591.921192] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c28cd20-910a-4442-bf58-8986fca235ae with Priority: HIGHEST for action port [ 591.921192] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c28cd20-910a-4442-bf58-8986fca235ae taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.921192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c28cd20-910a-4442-bf58-8986fca235ae" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.921192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c28cd20-910a-4442-bf58-8986fca235ae" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.922012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c28cd20-910a-4442-bf58-8986fca235ae" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.922284] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c28cd20-910a-4442-bf58-8986fca235ae',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.029270] env[66730]: INFO networking_nsxv3.common.synchronization [None req-e02a317e-4fb0-4577-9fcb-7a4dba659420 None None] Enqueued Resource ID: b72eaa57-35e6-469e-bd14-26a3605987c7 with Priority: HIGHEST for action port [ 592.029920] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: SUCCESS [ 592.029920] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.030734] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72eaa57-35e6-469e-bd14-26a3605987c7 with Priority: HIGHEST for action port [ 592.031191] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b72eaa57-35e6-469e-bd14-26a3605987c7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.031319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b72eaa57-35e6-469e-bd14-26a3605987c7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.031374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b72eaa57-35e6-469e-bd14-26a3605987c7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.031676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b72eaa57-35e6-469e-bd14-26a3605987c7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.032084] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72eaa57-35e6-469e-bd14-26a3605987c7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.277915] env[66730]: INFO networking_nsxv3.common.synchronization [None req-6e844569-3f42-472f-9b34-f6d388179e6b tempest-VolumesAssistedSnapshotsTest-130812955 tempest-VolumesAssistedSnapshotsTest-130812955-project-member] Enqueued Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_rules [ 592.279843] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_rules [ 592.280209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.280336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.280399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.280672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.280768] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.316968] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.317124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.317755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.317755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.317755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.317755] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.317919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.317919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.317976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.318495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.318495] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 already deleted. [ 592.318495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.427200] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c28cd20-910a-4442-bf58-8986fca235ae [ 592.427200] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.427200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.427200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.428259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.428259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.428259] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c28cd20-910a-4442-bf58-8986fca235ae already deleted. [ 592.429405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c28cd20-910a-4442-bf58-8986fca235ae" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.535460] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b72eaa57-35e6-469e-bd14-26a3605987c7 [ 592.535460] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.535460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.535460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.535785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.535785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.535876] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b72eaa57-35e6-469e-bd14-26a3605987c7 already deleted. [ 592.535996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b72eaa57-35e6-469e-bd14-26a3605987c7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.635022] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.635022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.635022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.635022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.635022] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.635022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.635022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.635022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.635022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.635022] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.635022] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.635022] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.635022] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.635732] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.635732] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.635732] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.655904] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.660026] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.660026] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.660026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.660026] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-84362d1f-4f7c-429c-9b69-665a8b9f408d taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.660026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-84362d1f-4f7c-429c-9b69-665a8b9f408d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.660026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-84362d1f-4f7c-429c-9b69-665a8b9f408d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.660026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-84362d1f-4f7c-429c-9b69-665a8b9f408d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.660026] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84362d1f-4f7c-429c-9b69-665a8b9f408d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.805854] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.806028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.806076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.806301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.806432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.806576] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b already deleted. [ 592.806685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.163485] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.163886] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.163886] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.164296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.164907] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.164907] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 84362d1f-4f7c-429c-9b69-665a8b9f408d not found, creating... [ 593.165030] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.165446] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.165446] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.165525] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.165639] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.166015] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.166201] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.166351] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.166513] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.166687] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.166847] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 84362d1f-4f7c-429c-9b69-665a8b9f408d is going to be created. [ 593.188144] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.188144] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.189691] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.189788] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.190026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.190248] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-84362d1f-4f7c-429c-9b69-665a8b9f408d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.289930] env[66730]: INFO networking_nsxv3.common.synchronization [None req-27de5a8e-e629-48ff-8cc5-fb6bbdcd7932 tempest-VolumesAssistedSnapshotsTest-130812955 tempest-VolumesAssistedSnapshotsTest-130812955-project-member] Enqueued Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_rules [ 593.291019] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_rules [ 593.291366] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.291497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.291565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.291772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.291854] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.785073] env[66730]: INFO networking_nsxv3.common.synchronization [None req-310c0985-beba-4b73-9fa5-3cc96ef82d17 None None] Enqueued Resource ID: 2b3d9f62-5ecf-48fe-8524-5b084e7e775a with Priority: HIGHEST for action port [ 593.785621] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b3d9f62-5ecf-48fe-8524-5b084e7e775a with Priority: HIGHEST for action port [ 593.785919] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b3d9f62-5ecf-48fe-8524-5b084e7e775a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.786086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b3d9f62-5ecf-48fe-8524-5b084e7e775a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.786121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b3d9f62-5ecf-48fe-8524-5b084e7e775a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.787292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b3d9f62-5ecf-48fe-8524-5b084e7e775a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.788446] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b3d9f62-5ecf-48fe-8524-5b084e7e775a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.819022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.819022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.819022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.819022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.819022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.819467] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b already deleted. [ 593.819467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.900978] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 in Status: SUCCESS [ 593.901522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.984473] env[66730]: INFO networking_nsxv3.common.synchronization [None req-3fee5f3f-d371-4893-97b1-b7b832f6269b None None] Enqueued Resource ID: 9ba4b3be-a752-4788-9e73-f2a4c6afc093 with Priority: HIGHEST for action port [ 593.985835] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4b3be-a752-4788-9e73-f2a4c6afc093 with Priority: HIGHEST for action port [ 593.986940] env[66730]: INFO networking_nsxv3.common.synchronization [req-33e73022-b1ee-4926-abe8-bdad18b4042f req-84eba2fd-85a6-44e2-94a7-0c03cc614fc4 tempest-DeleteServersAdminTestJSON-311808247 tempest-DeleteServersAdminTestJSON-311808247-project-member] Enqueued Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 593.987320] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ba4b3be-a752-4788-9e73-f2a4c6afc093 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.987451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ba4b3be-a752-4788-9e73-f2a4c6afc093" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.987501] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ba4b3be-a752-4788-9e73-f2a4c6afc093" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.987763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ba4b3be-a752-4788-9e73-f2a4c6afc093" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.987848] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ba4b3be-a752-4788-9e73-f2a4c6afc093',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.994704] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 593.994704] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.994704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.994704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.994704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.994704] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.994704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.994704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.994704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.994704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.994704] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.997684] env[66730]: INFO networking_nsxv3.common.synchronization [req-db575d5f-8e78-40f3-9d42-e5a2e4226147 req-a7d58c3f-08b9-4b58-92d6-0e34bbfb2bc2 service nova] Enqueued Resource ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 with Priority: HIGHEST for action security_group_rules [ 593.997684] env[66730]: INFO networking_nsxv3.common.synchronization [req-db575d5f-8e78-40f3-9d42-e5a2e4226147 req-a7d58c3f-08b9-4b58-92d6-0e34bbfb2bc2 service nova] Enqueued Resource ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 with Priority: HIGHEST for action security_group_members [ 593.997850] env[66730]: INFO networking_nsxv3.common.synchronization [req-db575d5f-8e78-40f3-9d42-e5a2e4226147 req-a7d58c3f-08b9-4b58-92d6-0e34bbfb2bc2 service nova] Enqueued Resource ID: 84362d1f-4f7c-429c-9b69-665a8b9f408d with Priority: HIGHEST for action port [ 593.998488] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 with Priority: HIGHEST for action security_group_rules [ 593.998662] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 with Priority: HIGHEST for action security_group_members [ 593.998790] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84362d1f-4f7c-429c-9b69-665a8b9f408d with Priority: HIGHEST for action port [ 594.000347] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ad5de68-7a54-4c50-932c-9a6fbf8463f4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.000347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.000347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.000347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.000347] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ad5de68-7a54-4c50-932c-9a6fbf8463f4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.000665] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.000665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.000749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.000939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.001532] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.001532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.001532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.001532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.001735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.001735] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ad5de68-7a54-4c50-932c-9a6fbf8463f4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.002627] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-84362d1f-4f7c-429c-9b69-665a8b9f408d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.003506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84362d1f-4f7c-429c-9b69-665a8b9f408d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.003506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84362d1f-4f7c-429c-9b69-665a8b9f408d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.003506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84362d1f-4f7c-429c-9b69-665a8b9f408d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.003506] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84362d1f-4f7c-429c-9b69-665a8b9f408d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.291779] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b3d9f62-5ecf-48fe-8524-5b084e7e775a [ 594.292122] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.292370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.292456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.292748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.292871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.292997] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b3d9f62-5ecf-48fe-8524-5b084e7e775a already deleted. [ 594.293151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b3d9f62-5ecf-48fe-8524-5b084e7e775a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.496411] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ba4b3be-a752-4788-9e73-f2a4c6afc093 [ 594.496932] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.496932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.496932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.497113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.497207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.497258] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ba4b3be-a752-4788-9e73-f2a4c6afc093 already deleted. [ 594.497858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ba4b3be-a752-4788-9e73-f2a4c6afc093" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.498764] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.500403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.500403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.500403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.500403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.500403] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.500403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.500403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.500403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.500403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.500403] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 already deleted. [ 594.500403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.504750] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ad5de68-7a54-4c50-932c-9a6fbf8463f4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.505926] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.505926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.506496] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84362d1f-4f7c-429c-9b69-665a8b9f408d with status ACTIVE [ 594.506496] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.506649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.506649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.506829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.506912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.507095] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.507191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.507249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.507403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.507493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.508015] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.508015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.508015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.508015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.508197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.508248] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84362d1f-4f7c-429c-9b69-665a8b9f408d is going to be updated. [ 594.528584] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.528904] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.529738] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.529738] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.529738] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.529738] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.529738] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.530023] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.530797] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.530797] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.530797] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.530797] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.530797] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.531035] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.531035] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.531420] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.535922] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.535999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.536097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.536350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.536509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.536738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84362d1f-4f7c-429c-9b69-665a8b9f408d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.566289] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.566456] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 594.566587] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.566840] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.567168] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-4704bea1-6c35-43ec-aec3-1e76d1387829 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.567337] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-4704bea1-6c35-43ec-aec3-1e76d1387829" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.567456] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-4704bea1-6c35-43ec-aec3-1e76d1387829" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.567812] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-4704bea1-6c35-43ec-aec3-1e76d1387829" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.567957] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4704bea1-6c35-43ec-aec3-1e76d1387829',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.007445] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ad5de68-7a54-4c50-932c-9a6fbf8463f4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.061738] env[66730]: INFO networking_nsxv3.common.synchronization [req-c4805c8d-e898-4364-98f0-c8c11f51dc68 req-7053bd5c-cc6a-471f-91b3-10af6969595f tempest-ServerExternalEventsTest-958867757 tempest-ServerExternalEventsTest-958867757-project-member] Enqueued Resource ID: 82256170-3225-4c5e-8d50-3e71dc76c846 with Priority: HIGHEST for action security_group_members [ 595.062140] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82256170-3225-4c5e-8d50-3e71dc76c846 with Priority: HIGHEST for action security_group_members [ 595.062464] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-82256170-3225-4c5e-8d50-3e71dc76c846 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.062579] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.062663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.062962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.063313] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.063471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.063560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.063770] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.063880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.064880] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82256170-3225-4c5e-8d50-3e71dc76c846',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.073273] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.073273] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.073273] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.073273] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.073273] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.073273] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 4704bea1-6c35-43ec-aec3-1e76d1387829 not found, creating... [ 595.073273] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.073273] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.073273] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.073273] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.073924] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.073924] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.074940] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.074940] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.075183] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.075392] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.075525] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 4704bea1-6c35-43ec-aec3-1e76d1387829 is going to be created. [ 595.102928] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.103161] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.103281] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.103566] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.103780] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.104008] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-4704bea1-6c35-43ec-aec3-1e76d1387829" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.451434] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.451782] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.451782] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.451954] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.452176] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.452322] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.452437] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.452650] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.452836] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.452988] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.453126] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.453231] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.453306] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.453405] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.453530] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.453631] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.471930] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.472138] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.472228] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.472390] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.472690] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-216f12ab-84e2-425e-8fe1-56cba4216b4b taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.472853] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-216f12ab-84e2-425e-8fe1-56cba4216b4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.472969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-216f12ab-84e2-425e-8fe1-56cba4216b4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.473479] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-216f12ab-84e2-425e-8fe1-56cba4216b4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.473642] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('216f12ab-84e2-425e-8fe1-56cba4216b4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.509910] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.510087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.510185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.510319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.510409] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.510509] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 is going to be created. [ 595.512323] env[66730]: INFO networking_nsxv3.common.synchronization [None req-b940f69a-895f-4000-9006-ea8672c54fec None None] Enqueued Resource ID: b63b83f3-5133-4c1f-b60b-a1faef84bd89 with Priority: HIGHEST for action port [ 595.512810] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b63b83f3-5133-4c1f-b60b-a1faef84bd89 with Priority: HIGHEST for action port [ 595.513501] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b63b83f3-5133-4c1f-b60b-a1faef84bd89 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.513681] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b63b83f3-5133-4c1f-b60b-a1faef84bd89" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.513750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b63b83f3-5133-4c1f-b60b-a1faef84bd89" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.513985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b63b83f3-5133-4c1f-b60b-a1faef84bd89" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.514106] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b63b83f3-5133-4c1f-b60b-a1faef84bd89',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.542107] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.542372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.542372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.542530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.542688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.556441] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 in Status: UNINITIALIZED for 2s [ 595.567864] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.568059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.568124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.568361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.568471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.568650] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.568749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.568798] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.568962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.569045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.569136] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82256170-3225-4c5e-8d50-3e71dc76c846 already deleted. [ 595.569210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.780021] env[66730]: INFO networking_nsxv3.common.synchronization [req-33e73022-b1ee-4926-abe8-bdad18b4042f req-36a57d3e-d118-4ae0-9f7d-7afed53f60fd service nova] Enqueued Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_rules [ 595.780021] env[66730]: INFO networking_nsxv3.common.synchronization [req-33e73022-b1ee-4926-abe8-bdad18b4042f req-36a57d3e-d118-4ae0-9f7d-7afed53f60fd service nova] Enqueued Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 595.780021] env[66730]: INFO networking_nsxv3.common.synchronization [req-33e73022-b1ee-4926-abe8-bdad18b4042f req-36a57d3e-d118-4ae0-9f7d-7afed53f60fd service nova] Enqueued Resource ID: 4704bea1-6c35-43ec-aec3-1e76d1387829 with Priority: HIGHEST for action port [ 595.780021] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_rules [ 595.780021] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 595.780021] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4704bea1-6c35-43ec-aec3-1e76d1387829 with Priority: HIGHEST for action port [ 595.780021] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.780021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.780021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.780021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.781526] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.783028] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.785018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.785018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.785018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.785018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.785018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.785018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.785018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.785018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.785018] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.788296] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-4704bea1-6c35-43ec-aec3-1e76d1387829 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.788428] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4704bea1-6c35-43ec-aec3-1e76d1387829" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.788485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4704bea1-6c35-43ec-aec3-1e76d1387829" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.788664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4704bea1-6c35-43ec-aec3-1e76d1387829" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.788741] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4704bea1-6c35-43ec-aec3-1e76d1387829',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.975584] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.975801] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.975923] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.976229] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.976375] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.976530] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 216f12ab-84e2-425e-8fe1-56cba4216b4b not found, creating... [ 595.976855] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.977024] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.977137] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.977350] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.977487] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.977814] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.977975] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.979018] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.979018] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.979134] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.979237] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 216f12ab-84e2-425e-8fe1-56cba4216b4b is going to be created. [ 596.004142] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.004142] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.004142] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.004142] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.004441] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.004520] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-216f12ab-84e2-425e-8fe1-56cba4216b4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.016424] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b63b83f3-5133-4c1f-b60b-a1faef84bd89 [ 596.016848] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.017107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.017184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.017396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.017484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.017578] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b63b83f3-5133-4c1f-b60b-a1faef84bd89 already deleted. [ 596.017708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b63b83f3-5133-4c1f-b60b-a1faef84bd89" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.232046] env[66730]: INFO networking_nsxv3.common.synchronization [req-7d831533-ae37-47e9-9baa-055a9f6a1a24 req-e03f876a-01b5-47e4-8197-5a3cf948c0c9 tempest-SecurityGroupRulesNegativeTestJSON-233755016 tempest-SecurityGroupRulesNegativeTestJSON-233755016-project-member] Enqueued Resource ID: 93a78eca-c503-4ba0-b25b-6e783eb5232e with Priority: HIGHEST for action security_group_rules [ 596.232871] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93a78eca-c503-4ba0-b25b-6e783eb5232e with Priority: HIGHEST for action security_group_rules [ 596.232871] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93a78eca-c503-4ba0-b25b-6e783eb5232e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.232871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93a78eca-c503-4ba0-b25b-6e783eb5232e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.233259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93a78eca-c503-4ba0-b25b-6e783eb5232e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.233496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93a78eca-c503-4ba0-b25b-6e783eb5232e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.233583] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93a78eca-c503-4ba0-b25b-6e783eb5232e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.291097] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.291260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.291436] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.292535] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4704bea1-6c35-43ec-aec3-1e76d1387829 with status ACTIVE [ 596.292741] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.292861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.292936] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.293176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.293294] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.293424] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.293520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.293582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.293732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.293806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.293981] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.294082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.294252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.294327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.294327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.294399] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4704bea1-6c35-43ec-aec3-1e76d1387829 is going to be updated. [ 596.327187] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.327364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.327443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.327594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.327763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.327937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4704bea1-6c35-43ec-aec3-1e76d1387829" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.758632] env[66730]: INFO networking_nsxv3.common.synchronization [req-c4805c8d-e898-4364-98f0-c8c11f51dc68 req-8d4c3177-6a5a-4b14-bc42-92e3d04c49ba service nova] Enqueued Resource ID: 82256170-3225-4c5e-8d50-3e71dc76c846 with Priority: HIGHEST for action security_group_rules [ 596.758632] env[66730]: INFO networking_nsxv3.common.synchronization [req-c4805c8d-e898-4364-98f0-c8c11f51dc68 req-8d4c3177-6a5a-4b14-bc42-92e3d04c49ba service nova] Enqueued Resource ID: 82256170-3225-4c5e-8d50-3e71dc76c846 with Priority: HIGHEST for action security_group_members [ 596.758632] env[66730]: INFO networking_nsxv3.common.synchronization [req-c4805c8d-e898-4364-98f0-c8c11f51dc68 req-8d4c3177-6a5a-4b14-bc42-92e3d04c49ba service nova] Enqueued Resource ID: 216f12ab-84e2-425e-8fe1-56cba4216b4b with Priority: HIGHEST for action port [ 596.759093] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.759467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.759562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.759786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.759873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.759961] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93a78eca-c503-4ba0-b25b-6e783eb5232e already deleted. [ 596.760052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93a78eca-c503-4ba0-b25b-6e783eb5232e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.760516] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82256170-3225-4c5e-8d50-3e71dc76c846 with Priority: HIGHEST for action security_group_rules [ 596.760657] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82256170-3225-4c5e-8d50-3e71dc76c846 with Priority: HIGHEST for action security_group_members [ 596.760759] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 216f12ab-84e2-425e-8fe1-56cba4216b4b with Priority: HIGHEST for action port [ 596.761096] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82256170-3225-4c5e-8d50-3e71dc76c846 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.761220] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.761286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.761512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.761595] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82256170-3225-4c5e-8d50-3e71dc76c846',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.762520] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-82256170-3225-4c5e-8d50-3e71dc76c846 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.762630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.762699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.762858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.763010] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.763681] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.763748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.763903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.763988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.764090] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82256170-3225-4c5e-8d50-3e71dc76c846',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.764913] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-216f12ab-84e2-425e-8fe1-56cba4216b4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.765021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-216f12ab-84e2-425e-8fe1-56cba4216b4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.765083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-216f12ab-84e2-425e-8fe1-56cba4216b4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.765304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-216f12ab-84e2-425e-8fe1-56cba4216b4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.765383] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('216f12ab-84e2-425e-8fe1-56cba4216b4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.796836] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.112991] env[66730]: INFO networking_nsxv3.common.synchronization [req-c7efcf29-557e-4133-87a9-64b6919062b7 req-25cdd84f-2c1c-43ab-b34f-9ba4d9e6c8bd tempest-FloatingIPsAssociationTestJSON-1582201638 tempest-FloatingIPsAssociationTestJSON-1582201638-project-member] Enqueued Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 597.113522] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 597.113847] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.113971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.114212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.114511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.118044] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.118044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.118044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.118044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.118044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.118044] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.268079] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82256170-3225-4c5e-8d50-3e71dc76c846',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.269842] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-82256170-3225-4c5e-8d50-3e71dc76c846 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.269998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.270142] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 216f12ab-84e2-425e-8fe1-56cba4216b4b with status ACTIVE [ 597.270350] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.270480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.270547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.270802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.270905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.271133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.271278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.271322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.272025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.272025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.272237] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.272349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.272582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.272827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.273130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.273464] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 216f12ab-84e2-425e-8fe1-56cba4216b4b is going to be updated. [ 597.300437] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.301091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.301412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.301610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.301768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.301933] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 is going to be created. [ 597.313614] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.313764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.313845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.314081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.314225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.314385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-216f12ab-84e2-425e-8fe1-56cba4216b4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.328558] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.328739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.328818] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.329067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.329228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.339288] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: UNINITIALIZED for 2s [ 597.567406] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 in Status: SUCCESS [ 597.567608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.567815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.568057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.568297] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.568392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.568427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.568609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.568686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.568782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.568961] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ad5de68-7a54-4c50-932c-9a6fbf8463f4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.612951] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-870 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.613400] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-870" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.613570] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-870" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.613984] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-870" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.614417] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.614625] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.614775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.615060] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.615244] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.615498] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.615640] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.615782] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.615917] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.616077] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.616235] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.616416] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.619337] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.619451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.619506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.619659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.619739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.619913] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.620032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.620073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.620217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.620313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.620396] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 already deleted. [ 597.620476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.636279] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.636434] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.636547] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.636728] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-870" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.637064] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-8a67ef28-b96a-4cb4-99b8-8c476b68ce25 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.637236] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-8a67ef28-b96a-4cb4-99b8-8c476b68ce25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.637348] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-8a67ef28-b96a-4cb4-99b8-8c476b68ce25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.637638] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-8a67ef28-b96a-4cb4-99b8-8c476b68ce25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.637779] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a67ef28-b96a-4cb4-99b8-8c476b68ce25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.776235] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82256170-3225-4c5e-8d50-3e71dc76c846',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.071509] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.071709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.071779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.072027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.072206] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.072322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.072381] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.072509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.072588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.072674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.072880] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.073018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.073081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.073233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.073366] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.073457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.073516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.073654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.073729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.073810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.073896] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ad5de68-7a54-4c50-932c-9a6fbf8463f4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.140238] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.140463] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.140582] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.140870] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.141028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.141185] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 8a67ef28-b96a-4cb4-99b8-8c476b68ce25 not found, creating... [ 598.141503] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.141566] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.141673] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.142094] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.142442] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.142576] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.142736] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.142859] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.143100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.143232] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.143369] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 8a67ef28-b96a-4cb4-99b8-8c476b68ce25 is going to be created. [ 598.165407] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.165586] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.165698] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.165969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.166204] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.166412] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-8a67ef28-b96a-4cb4-99b8-8c476b68ce25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.222328] env[66730]: INFO networking_nsxv3.common.synchronization [None req-6e5a8d48-a757-4b97-bee7-b359f7d0c807 None None] Enqueued Resource ID: 2270618a-3405-493b-bef5-e0db16ec465f with Priority: HIGHEST for action port [ 598.222862] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2270618a-3405-493b-bef5-e0db16ec465f with Priority: HIGHEST for action port [ 598.223170] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-2270618a-3405-493b-bef5-e0db16ec465f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.223422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2270618a-3405-493b-bef5-e0db16ec465f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.223422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2270618a-3405-493b-bef5-e0db16ec465f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.223642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2270618a-3405-493b-bef5-e0db16ec465f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.223737] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2270618a-3405-493b-bef5-e0db16ec465f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.279534] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.279764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.279764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.279988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.280101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.280206] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82256170-3225-4c5e-8d50-3e71dc76c846 is going to be created. [ 598.325053] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.325053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.325322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.325322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.325769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.337351] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82256170-3225-4c5e-8d50-3e71dc76c846 in Status: UNINITIALIZED for 2s [ 598.575949] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ad5de68-7a54-4c50-932c-9a6fbf8463f4: rpc.has_security_group_logging(os_id): False [ 598.595504] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.595727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.595727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.595959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.596077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.596261] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.596361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.596424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.596580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.596658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.596939] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.597028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.597095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.597240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.597315] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.597494] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.597590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.597653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.597827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.597880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.597967] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 is going to be created. [ 598.666311] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.666311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.666311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.666311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.666311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.682684] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 in Status: IN_PROGRESS for 2s [ 598.727998] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2270618a-3405-493b-bef5-e0db16ec465f [ 598.728248] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.728377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.728443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.728659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.728758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.728997] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2270618a-3405-493b-bef5-e0db16ec465f already deleted. [ 598.729146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2270618a-3405-493b-bef5-e0db16ec465f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.916570] env[66730]: INFO networking_nsxv3.common.synchronization [req-c7efcf29-557e-4133-87a9-64b6919062b7 req-8c1ab633-751e-46a5-a122-aea6fd06b1b1 service nova] Enqueued Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_rules [ 598.916845] env[66730]: INFO networking_nsxv3.common.synchronization [req-c7efcf29-557e-4133-87a9-64b6919062b7 req-8c1ab633-751e-46a5-a122-aea6fd06b1b1 service nova] Enqueued Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 598.917022] env[66730]: INFO networking_nsxv3.common.synchronization [req-c7efcf29-557e-4133-87a9-64b6919062b7 req-8c1ab633-751e-46a5-a122-aea6fd06b1b1 service nova] Enqueued Resource ID: 8a67ef28-b96a-4cb4-99b8-8c476b68ce25 with Priority: HIGHEST for action port [ 598.918042] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_rules [ 598.918042] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 598.918508] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a67ef28-b96a-4cb4-99b8-8c476b68ce25 with Priority: HIGHEST for action port [ 598.918894] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.918961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.919060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.919280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.919360] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.923159] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.923301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.923366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.923569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.925035] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.925035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.925035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.925899] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.926094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.926205] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.927164] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a67ef28-b96a-4cb4-99b8-8c476b68ce25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.927264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a67ef28-b96a-4cb4-99b8-8c476b68ce25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.927328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a67ef28-b96a-4cb4-99b8-8c476b68ce25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.927710] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a67ef28-b96a-4cb4-99b8-8c476b68ce25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.927710] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a67ef28-b96a-4cb4-99b8-8c476b68ce25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.356164] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: SUCCESS [ 599.356164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.356164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.356164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.356164] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.356164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.356164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.356164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.356164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.356164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.356164] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.428869] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.433273] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.433273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.434650] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a67ef28-b96a-4cb4-99b8-8c476b68ce25 with status ACTIVE [ 599.434789] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.434931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.434931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.435245] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.435346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.435970] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.436308] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.436378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.436689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.440223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.440486] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.440626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.441058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.441058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.441058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.441232] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a67ef28-b96a-4cb4-99b8-8c476b68ce25 is going to be updated. [ 599.444152] env[66730]: INFO networking_nsxv3.common.synchronization [req-e038f94a-83a5-4444-aad2-85ad3ce0195e req-b5283822-6bbd-4c0c-96f7-265f275c5725 tempest-MigrationsAdminTest-1802784989 tempest-MigrationsAdminTest-1802784989-project-member] Enqueued Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 599.444668] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 599.445418] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.446273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.446273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.446273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.446273] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.446273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.446273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.446604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.446604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.446663] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.473033] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.473504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.473564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.474029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.476203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.476203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a67ef28-b96a-4cb4-99b8-8c476b68ce25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.862856] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.863235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.863470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.863861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.864203] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.864998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.864998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.864998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.864998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.864998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.865576] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.865832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.865964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.866280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.866860] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.866860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.866860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.867054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.867365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.867365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.867566] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.935247] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.942026] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.942238] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.942317] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.942942] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.942942] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.943420] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.944041] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.944041] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.944041] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.945243] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.945243] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.945243] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.945243] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.945243] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.945243] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.945243] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.952608] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.952608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.952608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.952608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.953099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.953099] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.953099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.953272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.953323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.953436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.953483] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 already deleted. [ 599.954571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.969884] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.969884] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.971486] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.971486] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.971486] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-ea4935f6-e638-43f4-abe9-89b337611df1 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.971486] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-ea4935f6-e638-43f4-abe9-89b337611df1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.971486] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-ea4935f6-e638-43f4-abe9-89b337611df1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.972020] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-ea4935f6-e638-43f4-abe9-89b337611df1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.972020] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea4935f6-e638-43f4-abe9-89b337611df1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.348813] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82256170-3225-4c5e-8d50-3e71dc76c846 in Status: SUCCESS [ 600.349039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.350209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.350209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.350209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.350209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.350209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.350209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.350209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.350209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.350209] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82256170-3225-4c5e-8d50-3e71dc76c846',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.374919] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d62c76c-0a88-45ac-87f2-2212482e3159: rpc.has_security_group_logging(os_id): False [ 600.394706] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.394892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.394938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.395136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.395232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.395435] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.395534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.395599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.395745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.395826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.395993] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.396100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.396228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.396300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.396374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.396547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.396661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.396808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.396913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.396988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.397738] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 is going to be created. [ 600.438552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.438875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.438997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.439358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.439358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.439501] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 is going to be created. [ 600.475783] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.475992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.476212] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.476472] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.477583] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.477583] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port ea4935f6-e638-43f4-abe9-89b337611df1 not found, creating... [ 600.477583] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.477583] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.477583] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.477583] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.477922] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.478112] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.478477] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.478477] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.478636] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.478775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.478955] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: ea4935f6-e638-43f4-abe9-89b337611df1 is going to be created. [ 600.481650] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.481825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.481882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.482379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.482379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.497130] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.497330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.497376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.497684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.497954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.501688] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: UNINITIALIZED for 2s [ 600.511415] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: IN_PROGRESS for 2s [ 600.514076] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.514315] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.514434] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.514739] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.514947] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.515182] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-ea4935f6-e638-43f4-abe9-89b337611df1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.699234] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 in Status: SUCCESS [ 600.699234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.854431] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-82256170-3225-4c5e-8d50-3e71dc76c846 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.854431] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.854431] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-82256170-3225-4c5e-8d50-3e71dc76c846 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.854431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.854431] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.855204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.855204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.855204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.855204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.855204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.855204] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82256170-3225-4c5e-8d50-3e71dc76c846',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.261447] env[66730]: INFO networking_nsxv3.common.synchronization [None req-96d8e8c1-3615-44b5-a4ed-cc0ebb3ae5d3 None None] Enqueued Resource ID: 7cd0b4a1-90ac-42ab-8a2c-5457a466c4ca with Priority: HIGHEST for action port [ 601.262173] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd0b4a1-90ac-42ab-8a2c-5457a466c4ca with Priority: HIGHEST for action port [ 601.263029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cd0b4a1-90ac-42ab-8a2c-5457a466c4ca taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.263029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cd0b4a1-90ac-42ab-8a2c-5457a466c4ca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.263029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cd0b4a1-90ac-42ab-8a2c-5457a466c4ca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.263029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cd0b4a1-90ac-42ab-8a2c-5457a466c4ca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.263310] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cd0b4a1-90ac-42ab-8a2c-5457a466c4ca',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.277862] env[66730]: INFO networking_nsxv3.common.synchronization [req-e038f94a-83a5-4444-aad2-85ad3ce0195e req-6a03e945-33a9-497d-a9ce-ca007440e2b8 service nova] Enqueued Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_rules [ 601.277862] env[66730]: INFO networking_nsxv3.common.synchronization [req-e038f94a-83a5-4444-aad2-85ad3ce0195e req-6a03e945-33a9-497d-a9ce-ca007440e2b8 service nova] Enqueued Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 601.277862] env[66730]: INFO networking_nsxv3.common.synchronization [req-e038f94a-83a5-4444-aad2-85ad3ce0195e req-6a03e945-33a9-497d-a9ce-ca007440e2b8 service nova] Enqueued Resource ID: ea4935f6-e638-43f4-abe9-89b337611df1 with Priority: HIGHEST for action port [ 601.278645] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_rules [ 601.278645] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 601.278794] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea4935f6-e638-43f4-abe9-89b337611df1 with Priority: HIGHEST for action port [ 601.279857] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.279857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.279857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.279857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.280112] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.281017] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.281424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.281517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.281716] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.281881] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.281987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.282068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.282229] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.282329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.282427] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.283394] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea4935f6-e638-43f4-abe9-89b337611df1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.283521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea4935f6-e638-43f4-abe9-89b337611df1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.283593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea4935f6-e638-43f4-abe9-89b337611df1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.283890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea4935f6-e638-43f4-abe9-89b337611df1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.284500] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea4935f6-e638-43f4-abe9-89b337611df1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.360727] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82256170-3225-4c5e-8d50-3e71dc76c846: rpc.has_security_group_logging(os_id): False [ 601.381184] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.381441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.381539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.382137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.382137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.382243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.382318] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.382377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.382622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.382749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.382991] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.383305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.383437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.383649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.383732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.383993] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.384180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.384180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.384307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.384342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.384432] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82256170-3225-4c5e-8d50-3e71dc76c846 is going to be created. [ 601.466434] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.466699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.466699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.467059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.467283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.482734] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82256170-3225-4c5e-8d50-3e71dc76c846 in Status: IN_PROGRESS for 2s [ 601.675074] env[66730]: INFO networking_nsxv3.common.synchronization [None req-4cf5a52d-07e2-411a-a56b-4c0a30fa334a tempest-ServersV294TestFqdnHostnames-1063815950 tempest-ServersV294TestFqdnHostnames-1063815950-project-member] Enqueued Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_rules [ 601.675749] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_rules [ 601.676157] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.676298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.676397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.676704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.676980] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e4a2ee9-9ce1-46d2-900e-714dc4569d58',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.765872] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cd0b4a1-90ac-42ab-8a2c-5457a466c4ca [ 601.765872] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.765872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.765872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.765872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.765872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.765872] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cd0b4a1-90ac-42ab-8a2c-5457a466c4ca already deleted. [ 601.765872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cd0b4a1-90ac-42ab-8a2c-5457a466c4ca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.787560] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.787560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.787745] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.788991] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea4935f6-e638-43f4-abe9-89b337611df1 with status ACTIVE [ 601.789194] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.789305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.789366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.789816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.789990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.790536] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.790652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.790718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.791645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.791645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.791645] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.791645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.791645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.791645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.791645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.791645] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea4935f6-e638-43f4-abe9-89b337611df1 is going to be updated. [ 601.818366] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.818571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.818571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.818790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.818920] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.819105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea4935f6-e638-43f4-abe9-89b337611df1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.934135] env[66730]: INFO networking_nsxv3.common.synchronization [None req-9f37ce5d-58f6-46a5-8a97-10768b6ebb0f tempest-ServersV294TestFqdnHostnames-1063815950 tempest-ServersV294TestFqdnHostnames-1063815950-project-member] Enqueued Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_rules [ 601.934926] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_rules [ 601.935318] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.935462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.209299] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.209457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.209530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.209807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.209900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.210014] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 already deleted. [ 602.210112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.210310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.210505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.210834] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e4a2ee9-9ce1-46d2-900e-714dc4569d58',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.295079] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.515261] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: SUCCESS [ 602.515261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.515261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.515261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.515261] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.515261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.515261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.515261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.515261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.515695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.515889] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.528036] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: SUCCESS [ 602.528411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.754306] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.754414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.754476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.754721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.754848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.754945] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 already deleted. [ 602.754992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.797249] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.799581] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.799693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.799930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.800039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.800155] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 is going to be created. [ 602.851584] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.851814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.851814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.852079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.852301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.869607] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: UNINITIALIZED for 2s [ 603.022091] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.022467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.022467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.022682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.022845] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.022963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.023042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.023201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.023292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.023377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.023562] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.023903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.023979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.024241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.024804] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.024804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.024804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.024804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.025046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.025046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.025227] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.249703] env[66730]: INFO networking_nsxv3.common.synchronization [req-901237cb-ba1d-4740-b94d-aff11152ead3 req-39055244-de27-4808-88f6-974edc14b14d tempest-SecurityGroupRulesNegativeTestJSON-233755016 tempest-SecurityGroupRulesNegativeTestJSON-233755016-project-member] Enqueued Resource ID: 93a78eca-c503-4ba0-b25b-6e783eb5232e with Priority: HIGHEST for action security_group_rules [ 603.250664] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93a78eca-c503-4ba0-b25b-6e783eb5232e with Priority: HIGHEST for action security_group_rules [ 603.250955] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93a78eca-c503-4ba0-b25b-6e783eb5232e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.252295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93a78eca-c503-4ba0-b25b-6e783eb5232e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.252295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93a78eca-c503-4ba0-b25b-6e783eb5232e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.252295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93a78eca-c503-4ba0-b25b-6e783eb5232e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.252295] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93a78eca-c503-4ba0-b25b-6e783eb5232e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.502487] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82256170-3225-4c5e-8d50-3e71dc76c846 in Status: SUCCESS [ 603.502487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.527770] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdb05696-d6b8-4357-aa2d-95b0e293f154: rpc.has_security_group_logging(os_id): False [ 603.548792] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.549075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.549269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.549667] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.549928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.550454] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.550646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.550727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.550959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.551110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.551381] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.551545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.551637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.551856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.551977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.552253] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.553186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.553186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.553186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.553186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.553186] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 is going to be created. [ 603.626418] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.626675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.626675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.627370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.627370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.643192] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: IN_PROGRESS for 2s [ 603.778817] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.778993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.779054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.779329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.779432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.779537] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93a78eca-c503-4ba0-b25b-6e783eb5232e already deleted. [ 603.779620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93a78eca-c503-4ba0-b25b-6e783eb5232e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.872893] env[66730]: INFO networking_nsxv3.common.synchronization [None req-0680dcfc-a23a-4701-bb98-703fe7a3a4d6 None None] Enqueued Resource ID: 522ee37c-5f3d-4252-adef-8470b48733e5 with Priority: HIGHEST for action port [ 604.873538] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522ee37c-5f3d-4252-adef-8470b48733e5 with Priority: HIGHEST for action port [ 604.876460] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-522ee37c-5f3d-4252-adef-8470b48733e5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.876624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-522ee37c-5f3d-4252-adef-8470b48733e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.877226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-522ee37c-5f3d-4252-adef-8470b48733e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.878189] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-522ee37c-5f3d-4252-adef-8470b48733e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.878453] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('522ee37c-5f3d-4252-adef-8470b48733e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.882638] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: SUCCESS [ 604.882831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.882987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.883242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.883457] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.883574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.883639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.883795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.883878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.883961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.884060] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.997405] env[66730]: INFO networking_nsxv3.common.synchronization [req-9ed9e24f-384b-4ece-bb46-7ce10d85d057 req-13aa42bf-6bb9-42f7-958b-f9b8a9c15de7 tempest-FloatingIPsAssociationNegativeTestJSON-1868148739 tempest-FloatingIPsAssociationNegativeTestJSON-1868148739-project-member] Enqueued Resource ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 with Priority: HIGHEST for action security_group_members [ 604.998637] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 with Priority: HIGHEST for action security_group_members [ 604.999145] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.999596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.999596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.000041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.000290] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.000968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.000968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.001596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.002788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.002788] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cb9f836-7c49-4a1b-a86b-eb440ff5bf25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.382795] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 522ee37c-5f3d-4252-adef-8470b48733e5 [ 605.382795] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.382795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.382795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.382795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.382795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.382795] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:522ee37c-5f3d-4252-adef-8470b48733e5 already deleted. [ 605.382795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-522ee37c-5f3d-4252-adef-8470b48733e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.387317] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.387448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.389036] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.389036] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.389036] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.389036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.389529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.389529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.389529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.389529] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.486541] env[66730]: INFO networking_nsxv3.common.synchronization [None req-2b83a7b6-a7dd-4613-9e90-718f2106c588 None None] Enqueued Resource ID: f7d286b1-5bba-41ae-8d9b-4224f00ca42a with Priority: HIGHEST for action port [ 605.488196] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d286b1-5bba-41ae-8d9b-4224f00ca42a with Priority: HIGHEST for action port [ 605.488532] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7d286b1-5bba-41ae-8d9b-4224f00ca42a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.489017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7d286b1-5bba-41ae-8d9b-4224f00ca42a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.489017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7d286b1-5bba-41ae-8d9b-4224f00ca42a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.489287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7d286b1-5bba-41ae-8d9b-4224f00ca42a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.489378] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7d286b1-5bba-41ae-8d9b-4224f00ca42a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.506394] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.506857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.506857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.507030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.507082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.507258] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.507350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.507400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.507563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.507637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.507719] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 already deleted. [ 605.507819] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.665733] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: SUCCESS [ 605.665733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.698023] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.698023] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-994" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.698023] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-994" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.698023] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-994" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.698023] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.698023] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.698023] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.698721] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.698969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.699623] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.699827] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.700024] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.700209] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.700420] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.700601] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.700806] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.727725] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.727725] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.727725] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.727725] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-994" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.727725] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-56a88615-c3ef-4938-8762-54c61f204b92 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.727725] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-56a88615-c3ef-4938-8762-54c61f204b92" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.727725] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-56a88615-c3ef-4938-8762-54c61f204b92" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.727725] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-56a88615-c3ef-4938-8762-54c61f204b92" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.727725] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56a88615-c3ef-4938-8762-54c61f204b92',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.892477] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dd73e9d-f53e-4682-9229-6fa30e9d8043: rpc.has_security_group_logging(os_id): False [ 605.914688] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.914688] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.914688] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.914688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.915445] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.915445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.915445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.922266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.922266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.922266] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 is going to be created. [ 605.992560] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7d286b1-5bba-41ae-8d9b-4224f00ca42a [ 605.993156] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.993741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.993888] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.994115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.994300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.994300] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7d286b1-5bba-41ae-8d9b-4224f00ca42a already deleted. [ 605.994811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7d286b1-5bba-41ae-8d9b-4224f00ca42a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.003161] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.003384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.003563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.003767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.004042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.027380] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: IN_PROGRESS for 2s [ 606.232364] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.232364] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.232364] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.232364] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.232364] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.232364] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 56a88615-c3ef-4938-8762-54c61f204b92 not found, creating... [ 606.232364] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.232364] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.236354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.236354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.236354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.236354] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.236354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.236354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.236354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.236354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.236354] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 56a88615-c3ef-4938-8762-54c61f204b92 is going to be created. [ 606.267189] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.268374] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.269101] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.269578] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.272867] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.272867] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-56a88615-c3ef-4938-8762-54c61f204b92" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.789069] env[66730]: INFO networking_nsxv3.common.synchronization [None req-3d74dbd9-bf69-4767-957c-fe4855dee99c None None] Enqueued Resource ID: 26e0d2ee-f601-44fc-a4f7-bdace10fc590 with Priority: HIGHEST for action port [ 606.789892] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26e0d2ee-f601-44fc-a4f7-bdace10fc590 with Priority: HIGHEST for action port [ 606.790571] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-26e0d2ee-f601-44fc-a4f7-bdace10fc590 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.790571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26e0d2ee-f601-44fc-a4f7-bdace10fc590" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.791663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26e0d2ee-f601-44fc-a4f7-bdace10fc590" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.791663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26e0d2ee-f601-44fc-a4f7-bdace10fc590" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.791663] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26e0d2ee-f601-44fc-a4f7-bdace10fc590',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.001536] env[66730]: INFO networking_nsxv3.common.synchronization [req-9ed9e24f-384b-4ece-bb46-7ce10d85d057 req-5add123b-d9e3-4697-826a-6b165d9bc595 service nova] Enqueued Resource ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 with Priority: HIGHEST for action security_group_rules [ 607.001805] env[66730]: INFO networking_nsxv3.common.synchronization [req-9ed9e24f-384b-4ece-bb46-7ce10d85d057 req-5add123b-d9e3-4697-826a-6b165d9bc595 service nova] Enqueued Resource ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 with Priority: HIGHEST for action security_group_members [ 607.002032] env[66730]: INFO networking_nsxv3.common.synchronization [req-9ed9e24f-384b-4ece-bb46-7ce10d85d057 req-5add123b-d9e3-4697-826a-6b165d9bc595 service nova] Enqueued Resource ID: 56a88615-c3ef-4938-8762-54c61f204b92 with Priority: HIGHEST for action port [ 607.002613] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 with Priority: HIGHEST for action security_group_rules [ 607.002744] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 with Priority: HIGHEST for action security_group_members [ 607.002840] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56a88615-c3ef-4938-8762-54c61f204b92 with Priority: HIGHEST for action port [ 607.003135] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.003260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.003326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.003701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.003701] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cb9f836-7c49-4a1b-a86b-eb440ff5bf25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.006327] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.006327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.006327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.006327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.006327] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.006327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.006327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.006327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.006327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.006327] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cb9f836-7c49-4a1b-a86b-eb440ff5bf25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.011170] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-56a88615-c3ef-4938-8762-54c61f204b92 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.011386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56a88615-c3ef-4938-8762-54c61f204b92" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.011422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56a88615-c3ef-4938-8762-54c61f204b92" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.011596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56a88615-c3ef-4938-8762-54c61f204b92" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.011924] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56a88615-c3ef-4938-8762-54c61f204b92',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.093182] env[66730]: INFO networking_nsxv3.common.synchronization [req-f7b2fc52-8db3-4660-bcd5-78734cd40cbd req-0dca17b7-5183-4fdb-b8a7-7feb4f045d14 tempest-ImagesNegativeTestJSON-1481081547 tempest-ImagesNegativeTestJSON-1481081547-project-member] Enqueued Resource ID: 8ee53c94-9752-4f10-9e4b-a94683550515 with Priority: HIGHEST for action security_group_members [ 607.093357] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee53c94-9752-4f10-9e4b-a94683550515 with Priority: HIGHEST for action security_group_members [ 607.094580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ee53c94-9752-4f10-9e4b-a94683550515 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.095190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.095190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.095363] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.095537] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.096115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.096115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.096115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.096115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.096115] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ee53c94-9752-4f10-9e4b-a94683550515',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.293518] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26e0d2ee-f601-44fc-a4f7-bdace10fc590 [ 607.293875] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.296663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.296877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.297150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.297485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.297485] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26e0d2ee-f601-44fc-a4f7-bdace10fc590 already deleted. [ 607.297485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26e0d2ee-f601-44fc-a4f7-bdace10fc590" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.512026] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cb9f836-7c49-4a1b-a86b-eb440ff5bf25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.513183] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.513316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.515190] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56a88615-c3ef-4938-8762-54c61f204b92 with status ACTIVE [ 607.515190] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.515190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.515190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.515421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.515533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.516333] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.516333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.516333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.516333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.516333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.518068] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.518068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.518068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.518068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.518068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.518068] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56a88615-c3ef-4938-8762-54c61f204b92 is going to be updated. [ 607.549499] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.549499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.549499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.549499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.549499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.549499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56a88615-c3ef-4938-8762-54c61f204b92" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.589293] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-65 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.590890] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-65" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.590890] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-65" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.590890] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-65" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.590890] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.591144] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.591843] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.591843] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.591843] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.592096] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.592273] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.592475] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.592661] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.592829] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.593068] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.593282] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.601023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.601023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.601023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.601023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.601023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.601023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.601023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.601023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.601023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.601023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.601023] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ee53c94-9752-4f10-9e4b-a94683550515 already deleted. [ 607.601023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.621707] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.621943] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.622047] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.622217] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-65" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.622572] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-ca82c8b3-7180-43a2-b5a2-3943bb28754a taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.622733] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-ca82c8b3-7180-43a2-b5a2-3943bb28754a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.622850] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-ca82c8b3-7180-43a2-b5a2-3943bb28754a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.623259] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-ca82c8b3-7180-43a2-b5a2-3943bb28754a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.623446] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca82c8b3-7180-43a2-b5a2-3943bb28754a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.663066] env[66730]: INFO networking_nsxv3.common.synchronization [req-997c44fd-1340-40dc-b9f2-e257b18c52ce req-cc37f5b7-c4a1-4805-938e-b9e5f92dad55 tempest-InstanceActionsV221TestJSON-1274929290 tempest-InstanceActionsV221TestJSON-1274929290-project-member] Enqueued Resource ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 with Priority: HIGHEST for action security_group_members [ 607.663654] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 with Priority: HIGHEST for action security_group_members [ 607.664376] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.664706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.664706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.665064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.665248] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.665385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.665477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.665649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.665749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.665857] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86bff83e-5f97-4faa-9dfa-26142c6b8cf5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.015396] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cb9f836-7c49-4a1b-a86b-eb440ff5bf25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.041478] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: SUCCESS [ 608.041842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.128775] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.128775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.128775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.128775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.128775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.128775] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port ca82c8b3-7180-43a2-b5a2-3943bb28754a not found, creating... [ 608.128775] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.128775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.128775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.128775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.128775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.129378] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.129378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.129378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.129378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.129378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.130220] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: ca82c8b3-7180-43a2-b5a2-3943bb28754a is going to be created. [ 608.151572] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.151572] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.151572] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.152509] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.152509] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.152509] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-ca82c8b3-7180-43a2-b5a2-3943bb28754a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.169932] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.170115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.170246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.170575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.170694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.171066] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.171164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.171219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.171444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.171536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.171639] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 is going to be updated. [ 608.228660] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.228660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.228660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.228660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.228660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.248268] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 in Status: IN_PROGRESS for 2s [ 608.520562] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.520751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.520820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.521095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.521191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.521288] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 is going to be created. [ 608.546931] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.547176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.547312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.547701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.547958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.560252] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 in Status: UNINITIALIZED for 2s [ 608.817035] env[66730]: INFO networking_nsxv3.common.synchronization [None req-89864b8c-ef73-4ee0-abb8-f4eb310a4738 None None] Enqueued Resource ID: 93af0c61-b932-49fd-92a3-ba3610e0d301 with Priority: HIGHEST for action port [ 608.818456] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93af0c61-b932-49fd-92a3-ba3610e0d301 with Priority: HIGHEST for action port [ 608.819077] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-93af0c61-b932-49fd-92a3-ba3610e0d301 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.819263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93af0c61-b932-49fd-92a3-ba3610e0d301" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.819477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93af0c61-b932-49fd-92a3-ba3610e0d301" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.819784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93af0c61-b932-49fd-92a3-ba3610e0d301" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.819915] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93af0c61-b932-49fd-92a3-ba3610e0d301',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.890929] env[66730]: INFO networking_nsxv3.common.synchronization [req-f7b2fc52-8db3-4660-bcd5-78734cd40cbd req-94464503-8220-466f-8a2d-50ca303970fb service nova] Enqueued Resource ID: 8ee53c94-9752-4f10-9e4b-a94683550515 with Priority: HIGHEST for action security_group_rules [ 608.891149] env[66730]: INFO networking_nsxv3.common.synchronization [req-f7b2fc52-8db3-4660-bcd5-78734cd40cbd req-94464503-8220-466f-8a2d-50ca303970fb service nova] Enqueued Resource ID: 8ee53c94-9752-4f10-9e4b-a94683550515 with Priority: HIGHEST for action security_group_members [ 608.891316] env[66730]: INFO networking_nsxv3.common.synchronization [req-f7b2fc52-8db3-4660-bcd5-78734cd40cbd req-94464503-8220-466f-8a2d-50ca303970fb service nova] Enqueued Resource ID: ca82c8b3-7180-43a2-b5a2-3943bb28754a with Priority: HIGHEST for action port [ 608.891894] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee53c94-9752-4f10-9e4b-a94683550515 with Priority: HIGHEST for action security_group_rules [ 608.893640] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee53c94-9752-4f10-9e4b-a94683550515 with Priority: HIGHEST for action security_group_members [ 608.893853] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca82c8b3-7180-43a2-b5a2-3943bb28754a with Priority: HIGHEST for action port [ 608.894781] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ee53c94-9752-4f10-9e4b-a94683550515 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.894958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.895084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.896190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.896242] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ee53c94-9752-4f10-9e4b-a94683550515',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.898029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ee53c94-9752-4f10-9e4b-a94683550515 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.898642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.898642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.898642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.898806] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.898806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.898906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.899013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.899118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.899252] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ee53c94-9752-4f10-9e4b-a94683550515',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.900826] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca82c8b3-7180-43a2-b5a2-3943bb28754a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.900935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca82c8b3-7180-43a2-b5a2-3943bb28754a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.901010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca82c8b3-7180-43a2-b5a2-3943bb28754a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.901177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca82c8b3-7180-43a2-b5a2-3943bb28754a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.901258] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca82c8b3-7180-43a2-b5a2-3943bb28754a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.323095] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93af0c61-b932-49fd-92a3-ba3610e0d301 [ 609.323389] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.323389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.323508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.323707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.323782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.323988] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93af0c61-b932-49fd-92a3-ba3610e0d301 already deleted. [ 609.323988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93af0c61-b932-49fd-92a3-ba3610e0d301" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.398698] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ee53c94-9752-4f10-9e4b-a94683550515 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.398698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.401783] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ee53c94-9752-4f10-9e4b-a94683550515',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.409830] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca82c8b3-7180-43a2-b5a2-3943bb28754a with status ACTIVE [ 609.409830] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.409830] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.409830] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.409830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.409830] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca82c8b3-7180-43a2-b5a2-3943bb28754a is going to be updated. [ 609.435269] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.435487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.435487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.435879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.435879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.436109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca82c8b3-7180-43a2-b5a2-3943bb28754a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.499365] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7af3a706-3cd9-4e43-83ef-4231d5d9f1ca tempest-AttachVolumeShelveTestJSON-1677719075 tempest-AttachVolumeShelveTestJSON-1677719075-project-member] Enqueued Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_rules [ 609.499770] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_rules [ 609.500479] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.500739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.500971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.501407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.501568] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.532428] env[66730]: INFO networking_nsxv3.common.synchronization [req-8868fbf6-2f03-4638-80dc-dfd8495a61e9 req-2553eaf4-8700-4e33-9d60-63c432d798d5 tempest-VolumesAssistedSnapshotsTest-130812955 tempest-VolumesAssistedSnapshotsTest-130812955-project-member] Enqueued Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_members [ 609.533056] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_members [ 609.533697] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-93b3bb93-84fc-4123-b0bf-5f1575fd424b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.533697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.533697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.533859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.533994] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.534156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.534156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.534301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.534436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.534890] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.749490] env[66730]: INFO networking_nsxv3.common.synchronization [None req-1251f7e3-70bf-4aea-917f-3b800d627ee8 tempest-AttachVolumeShelveTestJSON-1677719075 tempest-AttachVolumeShelveTestJSON-1677719075-project-member] Enqueued Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_rules [ 609.750081] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_rules [ 609.750404] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.750512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.904385] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ee53c94-9752-4f10-9e4b-a94683550515',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.031354] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.031525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.031635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.031882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.032035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.032162] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 already deleted. [ 610.032282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.032450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.032632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.032727] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.037427] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.037577] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.037663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.037872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.037988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.038214] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.038368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.038418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.038609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.038714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.038829] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b already deleted. [ 610.038986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.049312] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.049521] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-113" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.049659] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-113" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.050017] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-113" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.051027] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.051225] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.051950] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.052202] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.052362] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.052608] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.052729] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.052862] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.052985] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.053128] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.053258] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.053413] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.082590] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.082855] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.083092] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.083346] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-113" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.083852] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-d2ea616a-5dfa-4d30-a1f7-b466e405c8bd taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.084050] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-d2ea616a-5dfa-4d30-a1f7-b466e405c8bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.084237] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-d2ea616a-5dfa-4d30-a1f7-b466e405c8bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.084471] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-d2ea616a-5dfa-4d30-a1f7-b466e405c8bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.084600] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2ea616a-5dfa-4d30-a1f7-b466e405c8bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.258097] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 in Status: SUCCESS [ 610.258289] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 deletion is rescheduled due to dependency. [ 610.258419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.408687] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.408959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.408959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.409195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.409289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.409385] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ee53c94-9752-4f10-9e4b-a94683550515 is going to be created. [ 610.436125] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.437025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.437025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.437177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.437269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.448025] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ee53c94-9752-4f10-9e4b-a94683550515 in Status: UNINITIALIZED for 2s [ 610.557522] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.557765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.557880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.558138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.558276] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.558396] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 already deleted. [ 610.558477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.583036] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 in Status: SUCCESS [ 610.583036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.583036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.583036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.583036] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.583036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.583036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.583036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.583036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.583036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.583036] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cb9f836-7c49-4a1b-a86b-eb440ff5bf25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.587428] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.587757] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.587933] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.588318] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.588513] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.589402] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port d2ea616a-5dfa-4d30-a1f7-b466e405c8bd not found, creating... [ 610.589402] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.589402] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.589680] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.589747] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.590319] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.590432] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.590653] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.590796] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.591200] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.591303] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.591502] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: d2ea616a-5dfa-4d30-a1f7-b466e405c8bd is going to be created. [ 610.642810] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.643170] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.643170] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.643419] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.643646] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.643890] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-d2ea616a-5dfa-4d30-a1f7-b466e405c8bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.087014] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.087296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.087296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.087602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.087711] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.087782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.087824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.088013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.088121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.088207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.088368] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.088463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.088527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.088659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.089038] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.089038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.089038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.089332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.089332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.089332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.089445] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cb9f836-7c49-4a1b-a86b-eb440ff5bf25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.360565] env[66730]: INFO networking_nsxv3.common.synchronization [req-8868fbf6-2f03-4638-80dc-dfd8495a61e9 req-197b4723-95ef-4bfd-9f75-8045a9b5160a service nova] Enqueued Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_rules [ 611.360565] env[66730]: INFO networking_nsxv3.common.synchronization [req-8868fbf6-2f03-4638-80dc-dfd8495a61e9 req-197b4723-95ef-4bfd-9f75-8045a9b5160a service nova] Enqueued Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_members [ 611.360565] env[66730]: INFO networking_nsxv3.common.synchronization [req-8868fbf6-2f03-4638-80dc-dfd8495a61e9 req-197b4723-95ef-4bfd-9f75-8045a9b5160a service nova] Enqueued Resource ID: d2ea616a-5dfa-4d30-a1f7-b466e405c8bd with Priority: HIGHEST for action port [ 611.360565] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_rules [ 611.360565] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_members [ 611.360565] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ea616a-5dfa-4d30-a1f7-b466e405c8bd with Priority: HIGHEST for action port [ 611.365527] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.365527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.365527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.365527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.365527] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.365527] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-93b3bb93-84fc-4123-b0bf-5f1575fd424b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.365527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.365527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.365527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.365527] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.365527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.365527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.366465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.366465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.366465] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.367274] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2ea616a-5dfa-4d30-a1f7-b466e405c8bd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.367411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2ea616a-5dfa-4d30-a1f7-b466e405c8bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.368242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2ea616a-5dfa-4d30-a1f7-b466e405c8bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.368242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2ea616a-5dfa-4d30-a1f7-b466e405c8bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.368242] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2ea616a-5dfa-4d30-a1f7-b466e405c8bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.595438] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25: rpc.has_security_group_logging(os_id): False [ 611.617269] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.617472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.617535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.617756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.617860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.618179] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.618325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.618378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.618522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.618601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.618840] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.619048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.619480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.619648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.619739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.619957] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.620083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.620146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.620330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.620412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.620505] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 is going to be created. [ 611.697906] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.698099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.698175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.698348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.698536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.725350] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 in Status: IN_PROGRESS for 2s [ 611.754684] env[66730]: INFO networking_nsxv3.common.synchronization [None req-c6180adb-1c2c-4a11-b637-b7a57ce4d92b tempest-ServersWithSpecificFlavorTestJSON-740738296 tempest-ServersWithSpecificFlavorTestJSON-740738296-project-member] Enqueued Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_rules [ 611.755377] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_rules [ 611.755843] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.756285] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.756368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.756708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.756823] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.871766] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.871766] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-93b3bb93-84fc-4123-b0bf-5f1575fd424b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.872074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.872876] env[66730]: INFO networking_nsxv3.common.synchronization [None req-cf3587aa-5ded-4cbd-875e-e38a43553acc tempest-ServersWithSpecificFlavorTestJSON-740738296 tempest-ServersWithSpecificFlavorTestJSON-740738296-project-member] Enqueued Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_rules [ 611.874190] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2ea616a-5dfa-4d30-a1f7-b466e405c8bd with status ACTIVE [ 611.874436] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.874568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.875425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.875425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.875425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.875425] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.875425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.875425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.875663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.875663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.875787] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.875885] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.875941] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.876221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.876221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.876331] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2ea616a-5dfa-4d30-a1f7-b466e405c8bd is going to be updated. [ 611.878488] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_rules [ 611.878840] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.878946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.901917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.902080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.902162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.902367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.902620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.902720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2ea616a-5dfa-4d30-a1f7-b466e405c8bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.288765] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.289997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.289997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.289997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.289997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.289997] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 already deleted. [ 612.290740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.290740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.291504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.291504] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.380947] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.460421] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ee53c94-9752-4f10-9e4b-a94683550515 in Status: SUCCESS [ 612.461105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.461481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.461888] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.462263] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.462569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.462814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.463165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.466536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.466536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.466536] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ee53c94-9752-4f10-9e4b-a94683550515',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.817130] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.817130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.817130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.817130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.817130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.817130] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 already deleted. [ 612.817130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.882868] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.883215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.883215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.883396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.883451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.883519] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b is going to be created. [ 612.924283] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.924283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.924593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.924653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.925465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.938223] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b in Status: UNINITIALIZED for 2s [ 612.970857] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ee53c94-9752-4f10-9e4b-a94683550515 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.971349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.971477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.971743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.972047] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.972365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.972455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.972759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.973126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.973312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.973641] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ee53c94-9752-4f10-9e4b-a94683550515 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.973870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.973980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.974175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.974259] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.974408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.974519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.974749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.974854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.974931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.975269] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ee53c94-9752-4f10-9e4b-a94683550515',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.481505] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ee53c94-9752-4f10-9e4b-a94683550515: rpc.has_security_group_logging(os_id): False [ 613.505117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.505117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.505117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.505117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.505813] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.505813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.505813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.507060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.507205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.507345] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ee53c94-9752-4f10-9e4b-a94683550515 is going to be created. [ 613.575751] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.575989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.575989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.576289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.576572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.590745] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ee53c94-9752-4f10-9e4b-a94683550515 in Status: IN_PROGRESS for 2s [ 613.741115] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 in Status: SUCCESS [ 613.742426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.814017] env[66730]: INFO networking_nsxv3.common.synchronization [req-da658abf-4d65-4018-a7b1-953382c31061 req-9bc6c04f-8dcf-4b7e-a274-5ce503bfff79 tempest-DeleteServersAdminTestJSON-984425455 tempest-DeleteServersAdminTestJSON-984425455-project-admin] Enqueued Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 613.814591] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 613.814923] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.815061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.815208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.815431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.815590] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.815732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.815813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.815973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.816075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.816195] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.318649] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.319079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.319079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.319236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.319350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.319588] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.319729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.319948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.320067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.320144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.320234] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 is going to be updated. [ 614.351166] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.351696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.351696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.351893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.351965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.362544] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: IN_PROGRESS for 2s [ 614.851467] env[66730]: INFO networking_nsxv3.common.synchronization [req-281aee8c-d701-4dee-98f0-91ffc3587b1f req-57a909cf-5f43-43e9-9a22-ff8100baeb47 tempest-ServersV294TestFqdnHostnames-1063815950 tempest-ServersV294TestFqdnHostnames-1063815950-project-member] Enqueued Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_members [ 614.852130] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_members [ 614.856143] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.856143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.856143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.856143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.856143] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.856143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.856143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.856143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.856143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.856143] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4a2ee9-9ce1-46d2-900e-714dc4569d58',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.952460] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b in Status: SUCCESS [ 614.952460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.952460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.952460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.952460] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.952460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.952460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.952460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.952825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.953000] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.953208] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.357460] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.357944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.357944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.358162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.358269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.358547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.358715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.358773] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.358946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.359037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.359126] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 already deleted. [ 615.359248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.428949] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.429157] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.429301] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.429701] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.429956] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.430155] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.430269] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.430647] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.430714] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.430940] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.431094] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.431212] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.431336] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.431442] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.431541] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.431687] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.455997] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.458021] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.458236] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.458373] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.458680] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.458903] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-345f1276-8628-4384-80dc-3a06beda8db7 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.459120] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-345f1276-8628-4384-80dc-3a06beda8db7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.459222] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-345f1276-8628-4384-80dc-3a06beda8db7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.459633] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-345f1276-8628-4384-80dc-3a06beda8db7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.459704] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('345f1276-8628-4384-80dc-3a06beda8db7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.611485] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ee53c94-9752-4f10-9e4b-a94683550515 in Status: SUCCESS [ 615.611735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.963844] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93b3bb93-84fc-4123-b0bf-5f1575fd424b: rpc.has_security_group_logging(os_id): False [ 615.964732] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.964883] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.965989] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.965989] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.965989] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.965989] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 345f1276-8628-4384-80dc-3a06beda8db7 not found, creating... [ 615.965989] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.965989] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.970290] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.970686] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.970853] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.971275] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.971398] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.971499] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.971733] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.971864] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.972014] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 345f1276-8628-4384-80dc-3a06beda8db7 is going to be created. [ 615.998530] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.998797] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.998860] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.999224] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.999500] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.999723] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-345f1276-8628-4384-80dc-3a06beda8db7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.001305] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.001477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.001551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.001741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.001887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.002213] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.002336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.002410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.002557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.002635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.002724] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b is going to be created. [ 616.114446] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.114685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.114731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.115401] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.115738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.139499] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b in Status: IN_PROGRESS for 2s [ 616.373697] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: SUCCESS [ 616.373882] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 deletion is rescheduled due to dependency. [ 616.373993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.381169] env[66730]: INFO networking_nsxv3.common.synchronization [req-d978782d-79ca-4274-8b5c-60c0a4cad4a2 req-6c23cd18-d647-41bd-91dd-144559ef1c9c tempest-ServerExternalEventsTest-958867757 tempest-ServerExternalEventsTest-958867757-project-member] Enqueued Resource ID: 82256170-3225-4c5e-8d50-3e71dc76c846 with Priority: HIGHEST for action security_group_members [ 616.381699] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82256170-3225-4c5e-8d50-3e71dc76c846 with Priority: HIGHEST for action security_group_members [ 616.382013] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-82256170-3225-4c5e-8d50-3e71dc76c846 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.382148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.382426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.382426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.382559] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.382653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.382708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.382850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.382930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.383033] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82256170-3225-4c5e-8d50-3e71dc76c846',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.814323] env[66730]: INFO networking_nsxv3.common.synchronization [req-281aee8c-d701-4dee-98f0-91ffc3587b1f req-216371db-39ee-4ae1-a6a6-9807e92758a3 service nova] Enqueued Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_rules [ 616.814609] env[66730]: INFO networking_nsxv3.common.synchronization [req-281aee8c-d701-4dee-98f0-91ffc3587b1f req-216371db-39ee-4ae1-a6a6-9807e92758a3 service nova] Enqueued Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_members [ 616.814609] env[66730]: INFO networking_nsxv3.common.synchronization [req-281aee8c-d701-4dee-98f0-91ffc3587b1f req-216371db-39ee-4ae1-a6a6-9807e92758a3 service nova] Enqueued Resource ID: 345f1276-8628-4384-80dc-3a06beda8db7 with Priority: HIGHEST for action port [ 616.816249] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_rules [ 616.816249] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_members [ 616.816249] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345f1276-8628-4384-80dc-3a06beda8db7 with Priority: HIGHEST for action port [ 616.816249] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.816249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.816249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.817840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.818019] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e4a2ee9-9ce1-46d2-900e-714dc4569d58',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.819018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.819147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.819212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.820040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.820225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.820336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.820475] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.820794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.820794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.820794] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4a2ee9-9ce1-46d2-900e-714dc4569d58',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.821852] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-345f1276-8628-4384-80dc-3a06beda8db7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.821971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-345f1276-8628-4384-80dc-3a06beda8db7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.822051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-345f1276-8628-4384-80dc-3a06beda8db7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.822230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-345f1276-8628-4384-80dc-3a06beda8db7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.822325] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('345f1276-8628-4384-80dc-3a06beda8db7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.889029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.889029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.889029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.889029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.889029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.889029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.889029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.889029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.889029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.889029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.889029] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82256170-3225-4c5e-8d50-3e71dc76c846 is going to be updated. [ 616.929103] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.929103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.929103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.929526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.929526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.940823] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82256170-3225-4c5e-8d50-3e71dc76c846 in Status: IN_PROGRESS for 2s [ 617.068859] env[66730]: INFO networking_nsxv3.common.synchronization [req-cbb7f204-9e7a-4485-b7c7-d374e5fce0cf req-5ed65762-323c-4c0e-9b5c-6342a0c18dca tempest-ServerPasswordTestJSON-799947988 tempest-ServerPasswordTestJSON-799947988-project-member] Enqueued Resource ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 with Priority: HIGHEST for action security_group_members [ 617.070059] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 with Priority: HIGHEST for action security_group_members [ 617.073223] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.073456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.073570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.073963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.074202] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.074329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.074398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.074566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.074653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.074752] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fee2eedb-c65a-44aa-aac1-bdad7895fbe4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.324242] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.324474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.324700] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 345f1276-8628-4384-80dc-3a06beda8db7 with status ACTIVE [ 617.324956] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.325074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.325163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.325644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.325789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.326049] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.326167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.326217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.326424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.326505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.326710] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.326802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.326879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.327429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.327529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.327620] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 345f1276-8628-4384-80dc-3a06beda8db7 is going to be updated. [ 617.328960] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4a2ee9-9ce1-46d2-900e-714dc4569d58',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.364741] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.364996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.365068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.365275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.365425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.365618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-345f1276-8628-4384-80dc-3a06beda8db7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.557283] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.557283] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-977" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.557283] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-977" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.557880] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-977" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.558325] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.559543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.559543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.559543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.559543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.559543] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.559543] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.559880] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.559880] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.559968] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.560037] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.560173] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.577831] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.578033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.578151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.578406] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.578502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.578700] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.578800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.578863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.579027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.579109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.579194] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 already deleted. [ 617.579410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.581247] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.581328] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.581460] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.581651] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-977" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.581970] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-5f69f137-57b1-43aa-9f0c-2a1f753e46cf taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.582183] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-5f69f137-57b1-43aa-9f0c-2a1f753e46cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.582333] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-5f69f137-57b1-43aa-9f0c-2a1f753e46cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.582632] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-5f69f137-57b1-43aa-9f0c-2a1f753e46cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.582822] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f69f137-57b1-43aa-9f0c-2a1f753e46cf',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.830983] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4a2ee9-9ce1-46d2-900e-714dc4569d58',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.086040] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.086040] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.086040] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.086424] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.086639] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.086861] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 5f69f137-57b1-43aa-9f0c-2a1f753e46cf not found, creating... [ 618.087239] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.087472] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.087660] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.087985] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.088228] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.088511] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.088877] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.088877] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.089047] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.089099] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.089234] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 5f69f137-57b1-43aa-9f0c-2a1f753e46cf is going to be created. [ 618.109620] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.109919] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.109919] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.110212] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.110431] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.110636] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-5f69f137-57b1-43aa-9f0c-2a1f753e46cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.151608] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b in Status: SUCCESS [ 618.151849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.333651] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.333860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.333901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.334138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.334259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.334360] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 is going to be created. [ 618.360606] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.360810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.360810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.361049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.361727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.371048] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 in Status: UNINITIALIZED for 2s [ 618.815017] env[66730]: INFO networking_nsxv3.common.synchronization [req-cbb7f204-9e7a-4485-b7c7-d374e5fce0cf req-a421cc9a-05d0-4230-aef1-a33d09b6cfa2 service nova] Enqueued Resource ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 with Priority: HIGHEST for action security_group_rules [ 618.815290] env[66730]: INFO networking_nsxv3.common.synchronization [req-cbb7f204-9e7a-4485-b7c7-d374e5fce0cf req-a421cc9a-05d0-4230-aef1-a33d09b6cfa2 service nova] Enqueued Resource ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 with Priority: HIGHEST for action security_group_members [ 618.815453] env[66730]: INFO networking_nsxv3.common.synchronization [req-cbb7f204-9e7a-4485-b7c7-d374e5fce0cf req-a421cc9a-05d0-4230-aef1-a33d09b6cfa2 service nova] Enqueued Resource ID: 5f69f137-57b1-43aa-9f0c-2a1f753e46cf with Priority: HIGHEST for action port [ 618.816779] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 with Priority: HIGHEST for action security_group_rules [ 618.816779] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 with Priority: HIGHEST for action security_group_members [ 618.816896] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f69f137-57b1-43aa-9f0c-2a1f753e46cf with Priority: HIGHEST for action port [ 618.817277] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fee2eedb-c65a-44aa-aac1-bdad7895fbe4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.817399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.817489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.817817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.818022] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fee2eedb-c65a-44aa-aac1-bdad7895fbe4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.819228] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.819349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.819417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.819607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.819763] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.819857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.819923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.821628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.821628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.821628] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fee2eedb-c65a-44aa-aac1-bdad7895fbe4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.821628] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f69f137-57b1-43aa-9f0c-2a1f753e46cf taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.821628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f69f137-57b1-43aa-9f0c-2a1f753e46cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.821628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f69f137-57b1-43aa-9f0c-2a1f753e46cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.822191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f69f137-57b1-43aa-9f0c-2a1f753e46cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.822191] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f69f137-57b1-43aa-9f0c-2a1f753e46cf',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.952456] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82256170-3225-4c5e-8d50-3e71dc76c846 in Status: SUCCESS [ 618.952877] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82256170-3225-4c5e-8d50-3e71dc76c846 deletion is rescheduled due to dependency. [ 618.953413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.324077] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.324227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.324423] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fee2eedb-c65a-44aa-aac1-bdad7895fbe4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.325387] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f69f137-57b1-43aa-9f0c-2a1f753e46cf with status ACTIVE [ 619.325587] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.325709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.325982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.325982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.326161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.326268] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.326402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.326447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.326610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.326684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.326859] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.327071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.327071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.327221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.327448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.327872] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f69f137-57b1-43aa-9f0c-2a1f753e46cf is going to be updated. [ 619.359045] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.359045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.359045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.359045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.359362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.359362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f69f137-57b1-43aa-9f0c-2a1f753e46cf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.475283] env[66730]: INFO networking_nsxv3.common.synchronization [None req-d9ca87b8-ecb3-408d-8ec4-a0845639c306 None None] Enqueued Resource ID: 21fbabf8-a012-49f7-880a-237e32769bc3 with Priority: HIGHEST for action port [ 619.475937] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21fbabf8-a012-49f7-880a-237e32769bc3 with Priority: HIGHEST for action port [ 619.477059] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-21fbabf8-a012-49f7-880a-237e32769bc3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.477223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21fbabf8-a012-49f7-880a-237e32769bc3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.477288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21fbabf8-a012-49f7-880a-237e32769bc3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.477573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21fbabf8-a012-49f7-880a-237e32769bc3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.477678] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21fbabf8-a012-49f7-880a-237e32769bc3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.749264] env[66730]: INFO networking_nsxv3.common.synchronization [req-2bc56a5f-fec0-4366-8fdc-0234618a2884 req-f9ac11f8-c7a5-47e8-ab5b-b47726a757ad tempest-AttachVolumeShelveTestJSON-1677719075 tempest-AttachVolumeShelveTestJSON-1677719075-project-member] Enqueued Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_members [ 619.749699] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_members [ 619.749699] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.749816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.749816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.752354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.752354] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.752715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.752715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.752715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.752715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.752839] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.834656] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fee2eedb-c65a-44aa-aac1-bdad7895fbe4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.981032] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21fbabf8-a012-49f7-880a-237e32769bc3 [ 619.981301] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.981507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.981686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.982025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.982190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.982533] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21fbabf8-a012-49f7-880a-237e32769bc3 already deleted. [ 619.982533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21fbabf8-a012-49f7-880a-237e32769bc3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.200097] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.202118] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.202118] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.202118] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.202424] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.204295] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.204393] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.205402] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.205402] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.205402] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.205402] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.205402] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.205402] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.205402] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.205706] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.205706] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.229809] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.230859] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.231034] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.231343] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.231604] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-8de1b916-dc96-492f-ab32-fd36252b6b08 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.231775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.231889] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.232274] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.232407] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de1b916-dc96-492f-ab32-fd36252b6b08',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.256546] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.256546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.256546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.256546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.256546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.256546] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.256546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.256546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.256546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.256546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.256546] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 already deleted. [ 620.256546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.337149] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.337375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.337375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.337598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.337678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.337774] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 is going to be created. [ 620.364382] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.364529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.364591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.364835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.365218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.378282] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 in Status: UNINITIALIZED for 2s [ 620.383104] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 in Status: SUCCESS [ 620.383437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.383623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.383964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.384279] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.384497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.384604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.384826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.385066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.385138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.385236] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e4a2ee9-9ce1-46d2-900e-714dc4569d58',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.736399] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.736680] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.736801] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.737249] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.737523] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.737693] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 8de1b916-dc96-492f-ab32-fd36252b6b08 not found, creating... [ 620.738063] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.738369] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.738369] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.738669] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.738891] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.739612] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.739777] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.739926] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.740404] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.740605] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.740680] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 8de1b916-dc96-492f-ab32-fd36252b6b08 is going to be created. [ 620.774009] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.774272] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.774435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.774752] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.776318] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.776406] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.888275] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e4a2ee9-9ce1-46d2-900e-714dc4569d58',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.390449] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e4a2ee9-9ce1-46d2-900e-714dc4569d58: rpc.has_security_group_logging(os_id): False [ 621.412415] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.412609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.412780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.413113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.413215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.414410] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.414410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.414410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.414410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.414410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.414410] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 is going to be created. [ 621.490352] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.490352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.490352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.490352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.490352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.505570] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 in Status: IN_PROGRESS for 2s [ 621.564600] env[66730]: INFO networking_nsxv3.common.synchronization [req-2bc56a5f-fec0-4366-8fdc-0234618a2884 req-ba108429-0cb9-4923-9bcd-b5844e16b636 service nova] Enqueued Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_rules [ 621.564775] env[66730]: INFO networking_nsxv3.common.synchronization [req-2bc56a5f-fec0-4366-8fdc-0234618a2884 req-ba108429-0cb9-4923-9bcd-b5844e16b636 service nova] Enqueued Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_members [ 621.564997] env[66730]: INFO networking_nsxv3.common.synchronization [req-2bc56a5f-fec0-4366-8fdc-0234618a2884 req-ba108429-0cb9-4923-9bcd-b5844e16b636 service nova] Enqueued Resource ID: 8de1b916-dc96-492f-ab32-fd36252b6b08 with Priority: HIGHEST for action port [ 621.565641] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_rules [ 621.566037] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_members [ 621.566037] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de1b916-dc96-492f-ab32-fd36252b6b08 with Priority: HIGHEST for action port [ 621.566833] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.566973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.567200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.567421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.570018] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.570018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.570018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.570018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.570018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.570018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.570018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.570018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.570018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.570018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.570018] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.571213] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-8de1b916-dc96-492f-ab32-fd36252b6b08 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.571354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.571573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.571958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.572103] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de1b916-dc96-492f-ab32-fd36252b6b08',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.798078] env[66730]: INFO networking_nsxv3.common.synchronization [None req-44f8011a-9a81-4eca-a443-851ae8d5c405 None None] Enqueued Resource ID: 25a12fb0-c4fa-478b-b766-c9fe5e3e988b with Priority: HIGHEST for action port [ 621.798078] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25a12fb0-c4fa-478b-b766-c9fe5e3e988b with Priority: HIGHEST for action port [ 621.798078] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-25a12fb0-c4fa-478b-b766-c9fe5e3e988b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.804271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25a12fb0-c4fa-478b-b766-c9fe5e3e988b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.804424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25a12fb0-c4fa-478b-b766-c9fe5e3e988b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.805348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25a12fb0-c4fa-478b-b766-c9fe5e3e988b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.805348] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25a12fb0-c4fa-478b-b766-c9fe5e3e988b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.074488] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.074835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.075303] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.076365] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8de1b916-dc96-492f-ab32-fd36252b6b08 with status ACTIVE [ 622.077508] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.077661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.077755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.078020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.078149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.078462] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.078615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.078763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.079093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.079093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.079265] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.079396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.079743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.079743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.079743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.079970] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8de1b916-dc96-492f-ab32-fd36252b6b08 is going to be updated. [ 622.103946] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.104229] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.104229] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.104430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.104483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.104649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.308505] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25a12fb0-c4fa-478b-b766-c9fe5e3e988b [ 622.308786] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.308934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.309042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.309400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.309400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.309569] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25a12fb0-c4fa-478b-b766-c9fe5e3e988b already deleted. [ 622.309713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25a12fb0-c4fa-478b-b766-c9fe5e3e988b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.396853] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 in Status: SUCCESS [ 622.397361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.399122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.399122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.399122] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.399822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.400044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.400312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.401902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.401902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.401902] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fee2eedb-c65a-44aa-aac1-bdad7895fbe4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.581882] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.824070] env[66730]: INFO networking_nsxv3.common.synchronization [req-d6168935-3b6a-4afb-9324-b50fa2e53a59 req-de891e0b-897d-49b0-bfc8-38ce2adb1efa tempest-TenantUsagesTestJSON-1643601631 tempest-TenantUsagesTestJSON-1643601631-project-member] Enqueued Resource ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 with Priority: HIGHEST for action security_group_members [ 622.824555] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 with Priority: HIGHEST for action security_group_members [ 622.825452] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.825452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.825452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.825698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.825873] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.826010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.826083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.826246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.826382] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.826726] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ad5de68-7a54-4c50-932c-9a6fbf8463f4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.903896] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.904072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.904167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.904354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.904516] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.904617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.904680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.904829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.904916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.905035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.905190] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.905282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.905341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.905515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.905638] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.905749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.905812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.905951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.906114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.906177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.906235] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fee2eedb-c65a-44aa-aac1-bdad7895fbe4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.088735] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.088735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.088735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.088735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.088735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.088735] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 is going to be created. [ 623.121181] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.121181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.121658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.123558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.123791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.137065] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: UNINITIALIZED for 2s [ 623.330746] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.330746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.330931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.331813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.331813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.331813] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.331813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.331813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.331813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.332110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.332110] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 is going to be updated. [ 623.367822] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.368774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.368774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.368774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.368774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.379434] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 in Status: IN_PROGRESS for 2s [ 623.408924] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fee2eedb-c65a-44aa-aac1-bdad7895fbe4: rpc.has_security_group_logging(os_id): False [ 623.432648] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.432869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.432869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.433226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.433516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.434104] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.434430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.434506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.434679] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.434782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.435400] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.435836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.435898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.436073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.436572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.436894] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.437016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.437104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.437263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.437362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.437491] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 is going to be created. [ 623.505503] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.505744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.505744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.505994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.506207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.522440] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 in Status: IN_PROGRESS for 2s [ 623.527352] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 in Status: SUCCESS [ 623.528065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.794037] env[66730]: INFO networking_nsxv3.common.synchronization [req-eece6053-a16f-464e-b8d9-041ee1e2f9bd req-0311dedc-a545-4021-880c-647329532b89 tempest-FloatingIPsAssociationTestJSON-1582201638 tempest-FloatingIPsAssociationTestJSON-1582201638-project-member] Enqueued Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 624.794037] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 624.794037] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.794037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.794037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.794037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.794037] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.794827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.794827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.796028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.796028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.796245] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.149148] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: SUCCESS [ 625.149591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.149591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.149591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.149871] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.149954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.149997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.150194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.150248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.150298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.150395] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.263188] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-870 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.263188] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-870" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.263188] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-870" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.263188] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-870" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.263637] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.263972] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.265040] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.265040] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.265040] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.265040] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.265260] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.265410] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.265561] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.265703] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.265836] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.266685] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.289377] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.290405] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.290405] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.290405] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-870" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.290405] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-09aec32b-d484-4978-b82b-8f1d7c4c046b taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.290675] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-09aec32b-d484-4978-b82b-8f1d7c4c046b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.290771] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-09aec32b-d484-4978-b82b-8f1d7c4c046b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.292817] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-09aec32b-d484-4978-b82b-8f1d7c4c046b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.292817] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09aec32b-d484-4978-b82b-8f1d7c4c046b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.299828] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.395730] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 in Status: SUCCESS [ 625.395730] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 deletion is rescheduled due to dependency. [ 625.395730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.536717] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 in Status: SUCCESS [ 625.537109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.653107] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.797365] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.797835] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.797835] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.797967] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.798119] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.798365] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 09aec32b-d484-4978-b82b-8f1d7c4c046b not found, creating... [ 625.798649] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.798877] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.799079] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.799401] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.799576] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.799892] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.800149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.800348] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.800669] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.800835] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.800993] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 09aec32b-d484-4978-b82b-8f1d7c4c046b is going to be created. [ 625.804979] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.829326] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.829856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.829856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.830146] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.830236] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.830383] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-09aec32b-d484-4978-b82b-8f1d7c4c046b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.156041] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef7021c1-fc61-456d-b596-a046fb1931e7: rpc.has_security_group_logging(os_id): False [ 626.177073] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.177322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.177403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.177654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.177767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.178074] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.178206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.178282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.178473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.178559] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.178673] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 is going to be created. [ 626.267432] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.267633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.267738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.268093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.268443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.284646] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: IN_PROGRESS for 2s [ 626.310588] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.310588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.310588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.310588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.310588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.310588] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 is going to be updated. [ 626.364083] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.364083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.364083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.364083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.364083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.375352] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: IN_PROGRESS for 2s [ 626.581992] env[66730]: INFO networking_nsxv3.common.synchronization [req-eece6053-a16f-464e-b8d9-041ee1e2f9bd req-6d2ddbe5-975a-404e-a934-eb23582e70a9 service nova] Enqueued Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_rules [ 626.582147] env[66730]: INFO networking_nsxv3.common.synchronization [req-eece6053-a16f-464e-b8d9-041ee1e2f9bd req-6d2ddbe5-975a-404e-a934-eb23582e70a9 service nova] Enqueued Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 626.583090] env[66730]: INFO networking_nsxv3.common.synchronization [req-eece6053-a16f-464e-b8d9-041ee1e2f9bd req-6d2ddbe5-975a-404e-a934-eb23582e70a9 service nova] Enqueued Resource ID: 09aec32b-d484-4978-b82b-8f1d7c4c046b with Priority: HIGHEST for action port [ 626.583090] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_rules [ 626.583090] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 626.583090] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09aec32b-d484-4978-b82b-8f1d7c4c046b with Priority: HIGHEST for action port [ 626.583730] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.583851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.583915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.585159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.585159] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.585283] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.585406] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.585931] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-09aec32b-d484-4978-b82b-8f1d7c4c046b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.586054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09aec32b-d484-4978-b82b-8f1d7c4c046b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.586118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09aec32b-d484-4978-b82b-8f1d7c4c046b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.586419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09aec32b-d484-4978-b82b-8f1d7c4c046b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.586498] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09aec32b-d484-4978-b82b-8f1d7c4c046b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.060584] env[66730]: INFO networking_nsxv3.common.synchronization [req-fe293a35-5ad2-44c9-aec3-7cabcf179b8a req-f5fbe0cf-882c-47c2-918e-7d76ad80e61a tempest-ImagesNegativeTestJSON-1481081547 tempest-ImagesNegativeTestJSON-1481081547-project-member] Enqueued Resource ID: 8ee53c94-9752-4f10-9e4b-a94683550515 with Priority: HIGHEST for action security_group_members [ 627.061093] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee53c94-9752-4f10-9e4b-a94683550515 with Priority: HIGHEST for action security_group_members [ 627.061410] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ee53c94-9752-4f10-9e4b-a94683550515 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.061698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.061698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.061807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.061942] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.062057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.062120] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.062289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.062379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.062475] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ee53c94-9752-4f10-9e4b-a94683550515',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.090058] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09aec32b-d484-4978-b82b-8f1d7c4c046b with status ACTIVE [ 627.091451] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.091451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.091451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.091451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.091451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.091451] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.091451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.091451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.091451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.091451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.092091] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.092091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.092091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.092091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.092314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.092314] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09aec32b-d484-4978-b82b-8f1d7c4c046b is going to be updated. [ 627.093850] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.093995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.119861] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.119861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.120137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.120693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.120693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.120891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09aec32b-d484-4978-b82b-8f1d7c4c046b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.567196] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.567469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.567540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.568014] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.568219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.568814] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.568814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.568814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.569306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.569306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.569532] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ee53c94-9752-4f10-9e4b-a94683550515 is going to be updated. [ 627.599669] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.599669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.599669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.600085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.600085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.612474] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ee53c94-9752-4f10-9e4b-a94683550515 in Status: IN_PROGRESS for 2s [ 628.300531] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: SUCCESS [ 628.300531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.385612] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: SUCCESS [ 628.385837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.386012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.386241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.386428] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.386545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.386611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.386763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.386844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.386937] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.456437] env[66730]: INFO networking_nsxv3.common.synchronization [None req-ff79d817-2e0d-4ae5-89b9-a2f56e3c7dde None None] Enqueued Resource ID: bbaadce1-4369-4e13-8696-3d5fe2a2ff90 with Priority: HIGHEST for action port [ 628.457995] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaadce1-4369-4e13-8696-3d5fe2a2ff90 with Priority: HIGHEST for action port [ 628.459794] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbaadce1-4369-4e13-8696-3d5fe2a2ff90 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.459981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbaadce1-4369-4e13-8696-3d5fe2a2ff90" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.460093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbaadce1-4369-4e13-8696-3d5fe2a2ff90" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.460543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbaadce1-4369-4e13-8696-3d5fe2a2ff90" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.460668] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbaadce1-4369-4e13-8696-3d5fe2a2ff90',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.890970] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.945356] env[66730]: INFO networking_nsxv3.common.synchronization [req-f7c50d93-b3a6-4d3b-88a4-132ad5f4b312 req-8d8e7321-fca2-4b9a-9fd7-48e8584db069 tempest-ServersWithSpecificFlavorTestJSON-740738296 tempest-ServersWithSpecificFlavorTestJSON-740738296-project-member] Enqueued Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 628.945755] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 628.946895] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.949112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.949234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.949620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.949712] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.949785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.949857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.950028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.950118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.950239] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.964560] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbaadce1-4369-4e13-8696-3d5fe2a2ff90 [ 628.964895] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.965106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.965224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.965497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.965643] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.965767] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbaadce1-4369-4e13-8696-3d5fe2a2ff90 already deleted. [ 628.965893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbaadce1-4369-4e13-8696-3d5fe2a2ff90" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.398044] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.455904] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.455904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.455904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.455904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.455904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.455904] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.455904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.455904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.455904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.455904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.455904] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 already deleted. [ 629.455904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.483822] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-236 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.484052] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-236" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.484161] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-236" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.484539] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-236" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.484827] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.484992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.488986] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.488986] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.488986] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.488986] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.488986] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.488986] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.488986] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.489390] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.489390] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.489390] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.513162] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.513162] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.513162] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.513162] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-236" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.513672] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-9a873648-ca08-4e04-98c5-429dd2477de5 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.513672] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-9a873648-ca08-4e04-98c5-429dd2477de5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.513822] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-9a873648-ca08-4e04-98c5-429dd2477de5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.517041] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-9a873648-ca08-4e04-98c5-429dd2477de5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.517041] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a873648-ca08-4e04-98c5-429dd2477de5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.623754] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ee53c94-9752-4f10-9e4b-a94683550515 in Status: SUCCESS [ 629.623987] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ee53c94-9752-4f10-9e4b-a94683550515 deletion is rescheduled due to dependency. [ 629.624125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.902981] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.902981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.902981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.902981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.902981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.902981] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 is going to be updated. [ 629.935963] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.936211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.936211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.936391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.936532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.945015] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: IN_PROGRESS for 2s [ 630.017791] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.017993] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.018143] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.018460] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.018609] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.019131] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 9a873648-ca08-4e04-98c5-429dd2477de5 not found, creating... [ 630.019416] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.019675] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.019796] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.020162] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.020959] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.021518] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.021730] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.021876] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.022181] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.022388] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.022607] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 9a873648-ca08-4e04-98c5-429dd2477de5 is going to be created. [ 630.044406] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.044644] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.044738] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.045169] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.045410] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.045630] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-9a873648-ca08-4e04-98c5-429dd2477de5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.415611] env[66730]: INFO networking_nsxv3.common.synchronization [None req-d2aaf14f-292b-4c83-a212-51c8ff70d6eb None None] Enqueued Resource ID: 71b9a0f4-cbb7-4ee6-b459-c53f9d138e43 with Priority: HIGHEST for action port [ 630.417339] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b9a0f4-cbb7-4ee6-b459-c53f9d138e43 with Priority: HIGHEST for action port [ 630.417339] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-71b9a0f4-cbb7-4ee6-b459-c53f9d138e43 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.417339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71b9a0f4-cbb7-4ee6-b459-c53f9d138e43" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.417564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71b9a0f4-cbb7-4ee6-b459-c53f9d138e43" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.417903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71b9a0f4-cbb7-4ee6-b459-c53f9d138e43" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.417989] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b9a0f4-cbb7-4ee6-b459-c53f9d138e43',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.841142] env[66730]: INFO networking_nsxv3.common.synchronization [req-f7c50d93-b3a6-4d3b-88a4-132ad5f4b312 req-a9453a1c-aacb-4929-a63f-bb0c6ffddf53 service nova] Enqueued Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_rules [ 630.841142] env[66730]: INFO networking_nsxv3.common.synchronization [req-f7c50d93-b3a6-4d3b-88a4-132ad5f4b312 req-a9453a1c-aacb-4929-a63f-bb0c6ffddf53 service nova] Enqueued Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 630.841142] env[66730]: INFO networking_nsxv3.common.synchronization [req-f7c50d93-b3a6-4d3b-88a4-132ad5f4b312 req-a9453a1c-aacb-4929-a63f-bb0c6ffddf53 service nova] Enqueued Resource ID: 9a873648-ca08-4e04-98c5-429dd2477de5 with Priority: HIGHEST for action port [ 630.841738] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_rules [ 630.841912] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 630.842072] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a873648-ca08-4e04-98c5-429dd2477de5 with Priority: HIGHEST for action port [ 630.842383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.842535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.843209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.843209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.843209] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.847021] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.847021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.847021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.847021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.847021] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.847021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.847021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.847730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.847730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.847730] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.848620] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a873648-ca08-4e04-98c5-429dd2477de5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.848767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a873648-ca08-4e04-98c5-429dd2477de5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.848863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a873648-ca08-4e04-98c5-429dd2477de5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.849056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a873648-ca08-4e04-98c5-429dd2477de5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.849863] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a873648-ca08-4e04-98c5-429dd2477de5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.920956] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71b9a0f4-cbb7-4ee6-b459-c53f9d138e43 [ 630.921256] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.921398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.922129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.922129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.922129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.922129] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71b9a0f4-cbb7-4ee6-b459-c53f9d138e43 already deleted. [ 630.922129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71b9a0f4-cbb7-4ee6-b459-c53f9d138e43" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.351364] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.353048] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.353254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.353815] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a873648-ca08-4e04-98c5-429dd2477de5 with status ACTIVE [ 631.358223] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.358454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.358570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.360110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.360451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.360787] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.361027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.361142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.361420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.361601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.362427] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.362574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.363642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.363642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.364076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.364926] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a873648-ca08-4e04-98c5-429dd2477de5 is going to be updated. [ 631.390413] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.390613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.390613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.390822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.390961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.391161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a873648-ca08-4e04-98c5-429dd2477de5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.854473] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.955258] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: SUCCESS [ 631.957470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.957470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.957470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.957470] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.957470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.957470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.957470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.957470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.957470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.957470] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.357775] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.357775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.357878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.358048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.358162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.358273] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 is going to be created. [ 632.391084] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.391477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.391477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.391561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.391673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.403076] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: UNINITIALIZED for 2s [ 632.410337] env[66730]: INFO networking_nsxv3.common.synchronization [None req-f949a398-41a8-4b3b-9c8c-baaeff29a05e None None] Enqueued Resource ID: 29d1d7da-4653-4837-a3d7-b4240cd2976d with Priority: HIGHEST for action port [ 632.410337] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d1d7da-4653-4837-a3d7-b4240cd2976d with Priority: HIGHEST for action port [ 632.410858] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-29d1d7da-4653-4837-a3d7-b4240cd2976d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.411012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29d1d7da-4653-4837-a3d7-b4240cd2976d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.411194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29d1d7da-4653-4837-a3d7-b4240cd2976d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29d1d7da-4653-4837-a3d7-b4240cd2976d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.411648] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29d1d7da-4653-4837-a3d7-b4240cd2976d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.460922] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.461279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.461279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.461910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.462057] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.462203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.462458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.462719] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.462894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.463118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.463243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.463552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.463552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.463622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.463781] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.463891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.463941] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.464535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.464659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.464801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.465544] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.914454] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29d1d7da-4653-4837-a3d7-b4240cd2976d [ 632.914798] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.914865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.915162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.915277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.915277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.915507] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29d1d7da-4653-4837-a3d7-b4240cd2976d already deleted. [ 632.915507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29d1d7da-4653-4837-a3d7-b4240cd2976d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.970027] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdb05696-d6b8-4357-aa2d-95b0e293f154: rpc.has_security_group_logging(os_id): False [ 632.991194] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.991386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.991456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.991871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.991871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.992288] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.992288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.992288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.992426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.992426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.992676] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.992676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.992856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.992856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.992960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.993108] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.993196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.993251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.993382] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.993615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.993615] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 is going to be updated. [ 633.062437] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.062437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.062437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.062680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.064932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.079217] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: IN_PROGRESS for 2s [ 634.164886] env[66730]: INFO networking_nsxv3.common.synchronization [None req-d1cd1dc0-450c-413e-adef-09d8a907514c None None] Enqueued Resource ID: 1a195065-2fe6-42c5-9991-99996d3ed760 with Priority: HIGHEST for action port [ 634.165784] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a195065-2fe6-42c5-9991-99996d3ed760 with Priority: HIGHEST for action port [ 634.166784] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a195065-2fe6-42c5-9991-99996d3ed760 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.166970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a195065-2fe6-42c5-9991-99996d3ed760" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.167034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a195065-2fe6-42c5-9991-99996d3ed760" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.168082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a195065-2fe6-42c5-9991-99996d3ed760" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.168082] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a195065-2fe6-42c5-9991-99996d3ed760',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.415065] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: SUCCESS [ 634.415065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.415065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.415065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.415065] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.415065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.415379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.415379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.415379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.415470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.416023] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.670184] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a195065-2fe6-42c5-9991-99996d3ed760 [ 634.670615] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.670615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.670778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.672415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.672415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.672415] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a195065-2fe6-42c5-9991-99996d3ed760 already deleted. [ 634.672415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a195065-2fe6-42c5-9991-99996d3ed760" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.741662] env[66730]: INFO networking_nsxv3.common.synchronization [None req-f3e43365-728b-491b-a8af-3a64d2676134 None None] Enqueued Resource ID: dbaff8e0-ebf2-4622-8c45-830680bf0430 with Priority: HIGHEST for action port [ 634.742988] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbaff8e0-ebf2-4622-8c45-830680bf0430 with Priority: HIGHEST for action port [ 634.742988] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbaff8e0-ebf2-4622-8c45-830680bf0430 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.742988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbaff8e0-ebf2-4622-8c45-830680bf0430" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.742988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbaff8e0-ebf2-4622-8c45-830680bf0430" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.742988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbaff8e0-ebf2-4622-8c45-830680bf0430" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.742988] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbaff8e0-ebf2-4622-8c45-830680bf0430',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.917676] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.095867] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: SUCCESS [ 635.095867] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.245193] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbaff8e0-ebf2-4622-8c45-830680bf0430 [ 635.245492] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.246080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.246080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.246080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.246080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.246364] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbaff8e0-ebf2-4622-8c45-830680bf0430 already deleted. [ 635.246364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbaff8e0-ebf2-4622-8c45-830680bf0430" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.421982] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a144e600-f0ab-4527-b46f-661bc4067c25: rpc.has_security_group_logging(os_id): False [ 635.444411] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.444852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.445030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.445350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.445633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.445988] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.446225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.446373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.446884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.447077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.447282] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 is going to be created. [ 635.515699] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.515859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.515908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.516494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.516494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.529760] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: IN_PROGRESS for 2s [ 636.455359] env[66730]: INFO networking_nsxv3.common.synchronization [None req-335eefa9-8803-455b-9897-ee1e681c60f9 None None] Enqueued Resource ID: afa74f54-1daf-4aeb-b0cb-99773c87381e with Priority: HIGHEST for action port [ 636.455987] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afa74f54-1daf-4aeb-b0cb-99773c87381e with Priority: HIGHEST for action port [ 636.456366] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-afa74f54-1daf-4aeb-b0cb-99773c87381e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.456533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afa74f54-1daf-4aeb-b0cb-99773c87381e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.456693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afa74f54-1daf-4aeb-b0cb-99773c87381e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.456886] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afa74f54-1daf-4aeb-b0cb-99773c87381e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.456961] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afa74f54-1daf-4aeb-b0cb-99773c87381e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.678588] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-838a8e88-daee-4ffc-b4ce-b1b52ac4bbdf tempest-ListServersNegativeTestJSON-1736181721 tempest-ListServersNegativeTestJSON-1736181721-project-member] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 636.679204] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 636.679555] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.679708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.679778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.680039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.680200] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.680306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.680384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.680541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.680629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.680727] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.744781] env[66730]: INFO networking_nsxv3.common.synchronization [None req-32d4ad34-f7cb-4035-9676-3aee33a36353 None None] Enqueued Resource ID: b4b07655-e50d-4989-9db9-3735b8ccfc12 with Priority: HIGHEST for action port [ 636.744781] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4b07655-e50d-4989-9db9-3735b8ccfc12 with Priority: HIGHEST for action port [ 636.744781] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4b07655-e50d-4989-9db9-3735b8ccfc12 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.744781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4b07655-e50d-4989-9db9-3735b8ccfc12" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.744781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4b07655-e50d-4989-9db9-3735b8ccfc12" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.744781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4b07655-e50d-4989-9db9-3735b8ccfc12" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.744781] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b07655-e50d-4989-9db9-3735b8ccfc12',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.960437] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afa74f54-1daf-4aeb-b0cb-99773c87381e [ 636.960680] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.960827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.960866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.961124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.961243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.961361] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afa74f54-1daf-4aeb-b0cb-99773c87381e already deleted. [ 636.961476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afa74f54-1daf-4aeb-b0cb-99773c87381e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.183723] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.183973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.184087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.184537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.184537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.184676] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.185673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.185766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.185879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.186044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.186123] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 already deleted. [ 637.186170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.213456] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-841 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.214132] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.214132] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.214322] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.214455] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.214656] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.214737] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.214955] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.215106] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.215342] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.215451] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.215537] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.215739] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.215739] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.216048] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.216048] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.238518] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.238656] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 637.238715] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.238889] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.239611] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-c51609ee-67d2-49c1-ac02-81bd4c513976 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.239611] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-c51609ee-67d2-49c1-ac02-81bd4c513976" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.239611] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-c51609ee-67d2-49c1-ac02-81bd4c513976" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.239895] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-c51609ee-67d2-49c1-ac02-81bd4c513976" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.239973] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c51609ee-67d2-49c1-ac02-81bd4c513976',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.247832] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4b07655-e50d-4989-9db9-3735b8ccfc12 [ 637.248839] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.250241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.250241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.250241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.250241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.250241] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4b07655-e50d-4989-9db9-3735b8ccfc12 already deleted. [ 637.250241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4b07655-e50d-4989-9db9-3735b8ccfc12" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.544764] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: SUCCESS [ 637.545536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.745040] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.745320] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.745442] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.745720] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.745902] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.746055] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port c51609ee-67d2-49c1-ac02-81bd4c513976 not found, creating... [ 637.746323] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.746532] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.746634] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.746812] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.746911] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.747205] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.747376] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.747501] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.747695] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.747820] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.747953] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: c51609ee-67d2-49c1-ac02-81bd4c513976 is going to be created. [ 637.773206] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.773969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.773969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.773969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.774182] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.774251] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-c51609ee-67d2-49c1-ac02-81bd4c513976" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.518160] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-d8a5ac1d-9a90-4bae-8d8a-c5160b40d2cb service nova] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_rules [ 638.518418] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-d8a5ac1d-9a90-4bae-8d8a-c5160b40d2cb service nova] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 638.518606] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-d8a5ac1d-9a90-4bae-8d8a-c5160b40d2cb service nova] Enqueued Resource ID: c51609ee-67d2-49c1-ac02-81bd4c513976 with Priority: HIGHEST for action port [ 638.519324] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_rules [ 638.519575] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 638.519743] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c51609ee-67d2-49c1-ac02-81bd4c513976 with Priority: HIGHEST for action port [ 638.520452] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.520452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.520452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.520690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.520793] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.522168] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.522306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.522397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.527271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.527271] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.527271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.527271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.527271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.527534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.527568] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.531074] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-c51609ee-67d2-49c1-ac02-81bd4c513976 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.531074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c51609ee-67d2-49c1-ac02-81bd4c513976" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.531074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c51609ee-67d2-49c1-ac02-81bd4c513976" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.531074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c51609ee-67d2-49c1-ac02-81bd4c513976" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.531074] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c51609ee-67d2-49c1-ac02-81bd4c513976',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.740211] env[66730]: INFO networking_nsxv3.common.synchronization [None req-8b8ab68c-155f-4b74-8113-b058d1f4a94b None None] Enqueued Resource ID: 6b57ddae-c8ef-416f-93f3-5459a899d71d with Priority: HIGHEST for action port [ 638.741697] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b57ddae-c8ef-416f-93f3-5459a899d71d with Priority: HIGHEST for action port [ 638.741697] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b57ddae-c8ef-416f-93f3-5459a899d71d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.741697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b57ddae-c8ef-416f-93f3-5459a899d71d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.741887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b57ddae-c8ef-416f-93f3-5459a899d71d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.742586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b57ddae-c8ef-416f-93f3-5459a899d71d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.742586] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b57ddae-c8ef-416f-93f3-5459a899d71d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.034698] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.034917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.035166] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.036304] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c51609ee-67d2-49c1-ac02-81bd4c513976 with status ACTIVE [ 639.036782] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.036782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.036950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.037426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.037426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.038155] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.038593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.038813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.039966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.039966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.039966] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.039966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.039966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.039966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.039966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.040336] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c51609ee-67d2-49c1-ac02-81bd4c513976 is going to be updated. [ 639.065452] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.065560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.065664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.065828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.066041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.066253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c51609ee-67d2-49c1-ac02-81bd4c513976" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.244812] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b57ddae-c8ef-416f-93f3-5459a899d71d [ 639.245164] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.245360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.245451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.245737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.245812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.245950] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b57ddae-c8ef-416f-93f3-5459a899d71d already deleted. [ 639.246778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b57ddae-c8ef-416f-93f3-5459a899d71d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.448427] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-903a235d-bef9-4933-b0d5-c13cf05fa62b tempest-ListServersNegativeTestJSON-1736181721 tempest-ListServersNegativeTestJSON-1736181721-project-member] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 639.449008] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 639.451122] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.451303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.544160] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.881460] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-841 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.881820] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.881820] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.882093] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.882381] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.882555] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.882685] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.882921] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.883259] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.883351] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.883436] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.883544] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.883648] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.883746] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.884349] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.884349] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.904257] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.904508] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.904679] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.904858] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.905207] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-f4f56a7e-8fb0-4a1f-b292-d9a3f7233510 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.905371] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-f4f56a7e-8fb0-4a1f-b292-d9a3f7233510" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.905481] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-f4f56a7e-8fb0-4a1f-b292-d9a3f7233510" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.905797] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-f4f56a7e-8fb0-4a1f-b292-d9a3f7233510" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.905928] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4f56a7e-8fb0-4a1f-b292-d9a3f7233510',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.046082] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.046324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.046324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.046696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.046696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.046859] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be created. [ 640.073468] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.073690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.073690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.073879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.074051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.092544] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: UNINITIALIZED for 2s [ 640.408389] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.408617] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.408738] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.409049] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.409201] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.409354] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port f4f56a7e-8fb0-4a1f-b292-d9a3f7233510 not found, creating... [ 640.409624] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.409770] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.409877] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.410116] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.410246] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.410524] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.410684] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.410776] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.410976] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.411118] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.411623] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: f4f56a7e-8fb0-4a1f-b292-d9a3f7233510 is going to be created. [ 640.433373] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.433561] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.433715] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.434119] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.434533] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.434621] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-f4f56a7e-8fb0-4a1f-b292-d9a3f7233510" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.895446] env[66730]: INFO networking_nsxv3.common.synchronization [None req-dee2c98a-227d-4df9-9261-fe3845944066 None None] Enqueued Resource ID: 6288c0bd-a488-4d7a-9f2b-456861040c55 with Priority: HIGHEST for action port [ 640.895446] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6288c0bd-a488-4d7a-9f2b-456861040c55 with Priority: HIGHEST for action port [ 640.895758] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-6288c0bd-a488-4d7a-9f2b-456861040c55 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.895758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6288c0bd-a488-4d7a-9f2b-456861040c55" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.895879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6288c0bd-a488-4d7a-9f2b-456861040c55" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.896684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6288c0bd-a488-4d7a-9f2b-456861040c55" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.896684] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6288c0bd-a488-4d7a-9f2b-456861040c55',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.186681] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-c6636a04-1055-459d-96d8-028c1eb4154f service nova] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_rules [ 641.186910] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-c6636a04-1055-459d-96d8-028c1eb4154f service nova] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 641.186980] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-c6636a04-1055-459d-96d8-028c1eb4154f service nova] Enqueued Resource ID: f4f56a7e-8fb0-4a1f-b292-d9a3f7233510 with Priority: HIGHEST for action port [ 641.187512] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_rules [ 641.187636] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 641.187819] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4f56a7e-8fb0-4a1f-b292-d9a3f7233510 with Priority: HIGHEST for action port [ 641.187991] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.188223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.188362] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.188441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.192115] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4f56a7e-8fb0-4a1f-b292-d9a3f7233510 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.192115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4f56a7e-8fb0-4a1f-b292-d9a3f7233510" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.192115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4f56a7e-8fb0-4a1f-b292-d9a3f7233510" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.192115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4f56a7e-8fb0-4a1f-b292-d9a3f7233510" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.192115] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4f56a7e-8fb0-4a1f-b292-d9a3f7233510',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.399529] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6288c0bd-a488-4d7a-9f2b-456861040c55 [ 641.400937] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.400937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.400937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.400937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.400937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.400937] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6288c0bd-a488-4d7a-9f2b-456861040c55 already deleted. [ 641.400937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6288c0bd-a488-4d7a-9f2b-456861040c55" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.693217] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4f56a7e-8fb0-4a1f-b292-d9a3f7233510 with status ACTIVE [ 641.693217] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.693217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.693217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.693217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.693217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.693217] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.693217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.693217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.693217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.693217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.693217] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.693217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.693217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.693703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.693703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.693703] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4f56a7e-8fb0-4a1f-b292-d9a3f7233510 is going to be updated. [ 641.714544] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.714849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.714849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.715820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.715820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.715820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4f56a7e-8fb0-4a1f-b292-d9a3f7233510" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.982179] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-20eae5f0-5b0d-4eab-80f0-267384c29b86 tempest-ListServersNegativeTestJSON-1736181721 tempest-ListServersNegativeTestJSON-1736181721-project-member] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 641.983473] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 641.983634] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.983765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.105972] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 642.107017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.107017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.107017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.107017] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.107319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.107319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.109979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.109979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.109979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.109979] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.111035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.111035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.111035] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.111297] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.111297] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.111412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.111412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.111554] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.579022] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-841 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.579022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.579022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.579022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.579736] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.581119] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.581119] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.581119] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.581119] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.581119] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.581119] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.581788] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.582048] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.582345] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.583594] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.583594] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.608642] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.608642] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.608642] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.608642] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-841" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.608642] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-cba192b6-8799-4948-8a83-aa467229db26 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.608642] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-cba192b6-8799-4948-8a83-aa467229db26" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.608642] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-cba192b6-8799-4948-8a83-aa467229db26" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.608642] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-cba192b6-8799-4948-8a83-aa467229db26" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.608642] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cba192b6-8799-4948-8a83-aa467229db26',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.612942] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.613298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.616477] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.110680] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.111091] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.111091] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.111330] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.111474] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.111631] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port cba192b6-8799-4948-8a83-aa467229db26 not found, creating... [ 643.111914] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.112083] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.112203] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.112442] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.112575] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.112848] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.113544] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.113736] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.115179] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.115442] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.115572] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: cba192b6-8799-4948-8a83-aa467229db26 is going to be created. [ 643.118688] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.136367] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.137264] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.137635] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.137983] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.138364] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.138704] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-cba192b6-8799-4948-8a83-aa467229db26" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.289941] env[66730]: INFO networking_nsxv3.common.synchronization [None req-d319a387-e643-40af-aa64-b2e6bd71e89e None None] Enqueued Resource ID: e1a79120-a7a3-4e71-9227-cd579cb5db21 with Priority: HIGHEST for action port [ 643.290380] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1a79120-a7a3-4e71-9227-cd579cb5db21 with Priority: HIGHEST for action port [ 643.290700] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1a79120-a7a3-4e71-9227-cd579cb5db21 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.291165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1a79120-a7a3-4e71-9227-cd579cb5db21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.291321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1a79120-a7a3-4e71-9227-cd579cb5db21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.291704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1a79120-a7a3-4e71-9227-cd579cb5db21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.291859] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a79120-a7a3-4e71-9227-cd579cb5db21',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.623169] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.623169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.623169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.623368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.623461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.623621] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be updated. [ 643.663057] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.663287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.663898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.664069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.664193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.676373] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: IN_PROGRESS for 2s [ 643.755330] env[66730]: INFO networking_nsxv3.common.synchronization [None req-ac4b2693-6ab3-40b9-9195-47db6bb57ebe tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_rules [ 643.756629] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_rules [ 643.756957] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.757112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.757159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.757674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.757674] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.796357] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1a79120-a7a3-4e71-9227-cd579cb5db21 [ 643.796357] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.796357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.796357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.796357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.796357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.796357] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1a79120-a7a3-4e71-9227-cd579cb5db21 already deleted. [ 643.796357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1a79120-a7a3-4e71-9227-cd579cb5db21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.932490] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-721108ff-171c-4950-a07b-44aef2888b00 service nova] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_rules [ 643.932706] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-721108ff-171c-4950-a07b-44aef2888b00 service nova] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 643.932888] env[66730]: INFO networking_nsxv3.common.synchronization [req-c410685e-2bc0-4028-a1d7-7ced4fef0575 req-721108ff-171c-4950-a07b-44aef2888b00 service nova] Enqueued Resource ID: cba192b6-8799-4948-8a83-aa467229db26 with Priority: HIGHEST for action port [ 643.933568] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_rules [ 643.933675] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 643.934127] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cba192b6-8799-4948-8a83-aa467229db26 with Priority: HIGHEST for action port [ 643.934451] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.934546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.934773] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.934870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.935173] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-cba192b6-8799-4948-8a83-aa467229db26 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.935173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cba192b6-8799-4948-8a83-aa467229db26" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.935318] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cba192b6-8799-4948-8a83-aa467229db26" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.935811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cba192b6-8799-4948-8a83-aa467229db26" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.935811] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cba192b6-8799-4948-8a83-aa467229db26',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.946709] env[66730]: INFO networking_nsxv3.common.synchronization [None req-2319d2df-b65a-421d-9d99-a87ea6c4990c tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_rules [ 643.947359] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_rules [ 643.949545] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.949706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.278862] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.280038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.280038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.280191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.280231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.280314] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 already deleted. [ 644.280402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.280545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.280697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.280780] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.437930] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cba192b6-8799-4948-8a83-aa467229db26 with status ACTIVE [ 644.438299] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.438442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.438522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.438733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.438826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.438978] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.439096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.439166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.439279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.439347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.439529] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.439705] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.439705] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.439832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.439905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.439989] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cba192b6-8799-4948-8a83-aa467229db26 is going to be updated. [ 644.462429] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.462575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.462650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.463056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.463207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.463433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cba192b6-8799-4948-8a83-aa467229db26" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.803117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.803269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.803342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.803557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.803641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.803808] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 already deleted. [ 644.803808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.694052] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 645.694585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.694585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.694731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.694861] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.694987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.695067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.695246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.695370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.695418] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.791335] env[66730]: INFO networking_nsxv3.common.synchronization [req-3ec05d96-d171-4092-bcf5-a4d5bb12b020 req-7babedd7-7e3d-42fc-bdb9-de9c3ac1223d tempest-DeleteServersAdminTestJSON-311808247 tempest-DeleteServersAdminTestJSON-311808247-project-member] Enqueued Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 645.792729] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 645.793072] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.793969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.793969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.793969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.793969] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.793969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.793969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.793969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.794530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.794530] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.201561] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.271071] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.271071] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.271384] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.271509] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.271710] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.271885] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.271975] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.272212] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.272384] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.272589] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.272713] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.272810] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.272941] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.273073] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.273171] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.273280] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.297582] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.297582] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.297582] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.297582] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.299127] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-5d456862-5ecf-41ed-8f78-57f966e2824b taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.299127] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-5d456862-5ecf-41ed-8f78-57f966e2824b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.299127] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-5d456862-5ecf-41ed-8f78-57f966e2824b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.299127] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-5d456862-5ecf-41ed-8f78-57f966e2824b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.299127] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d456862-5ecf-41ed-8f78-57f966e2824b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.300110] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.300336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.300336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.300604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.301289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.301289] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.301289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.301820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.301820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.301820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.302464] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 is going to be updated. [ 646.341613] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.341862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.341919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.342158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.342304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.359853] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: IN_PROGRESS for 2s [ 646.704195] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.805068] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.805068] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.805275] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.805467] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.805635] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.806045] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 5d456862-5ecf-41ed-8f78-57f966e2824b not found, creating... [ 646.806045] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.806207] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.806921] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.806921] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.806921] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.806921] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.807146] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.807146] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.807666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.807666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.807778] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 5d456862-5ecf-41ed-8f78-57f966e2824b is going to be created. [ 646.836599] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.836599] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.836599] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.836599] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.836599] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.836599] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-5d456862-5ecf-41ed-8f78-57f966e2824b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.208645] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.208853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.208919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.209188] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.209293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.209550] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be updated. [ 647.252150] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.252150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.252565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.252565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.252565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.272939] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: IN_PROGRESS for 2s [ 647.589096] env[66730]: INFO networking_nsxv3.common.synchronization [req-3ec05d96-d171-4092-bcf5-a4d5bb12b020 req-b6f29631-c951-4aca-8b78-55b4578c68d6 service nova] Enqueued Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_rules [ 647.589296] env[66730]: INFO networking_nsxv3.common.synchronization [req-3ec05d96-d171-4092-bcf5-a4d5bb12b020 req-b6f29631-c951-4aca-8b78-55b4578c68d6 service nova] Enqueued Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 647.589419] env[66730]: INFO networking_nsxv3.common.synchronization [req-3ec05d96-d171-4092-bcf5-a4d5bb12b020 req-b6f29631-c951-4aca-8b78-55b4578c68d6 service nova] Enqueued Resource ID: 5d456862-5ecf-41ed-8f78-57f966e2824b with Priority: HIGHEST for action port [ 647.590236] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_rules [ 647.590552] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 647.590552] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d456862-5ecf-41ed-8f78-57f966e2824b with Priority: HIGHEST for action port [ 647.590943] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.591098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.591098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.591311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.591401] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.600745] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.600745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.600745] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d456862-5ecf-41ed-8f78-57f966e2824b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.600745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d456862-5ecf-41ed-8f78-57f966e2824b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.600745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d456862-5ecf-41ed-8f78-57f966e2824b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.600745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d456862-5ecf-41ed-8f78-57f966e2824b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.600745] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d456862-5ecf-41ed-8f78-57f966e2824b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.102113] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.102113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.102113] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d456862-5ecf-41ed-8f78-57f966e2824b with status ACTIVE [ 648.102113] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.102113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.102113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.102113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.102113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.102113] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.102113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.102113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.102113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.102113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.102113] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.103385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.103385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.103385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.103385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.103385] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d456862-5ecf-41ed-8f78-57f966e2824b is going to be updated. [ 648.126270] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.126615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.126791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.127107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.127360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.127695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d456862-5ecf-41ed-8f78-57f966e2824b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.332898] env[66730]: INFO networking_nsxv3.common.synchronization [req-98b490d7-9354-47a5-8f3e-ddf14c74fa5f req-2292e67d-3c56-4e53-8a11-f362ba94bcae tempest-ServerDiagnosticsNegativeTest-1449471440 tempest-ServerDiagnosticsNegativeTest-1449471440-project-member] Enqueued Resource ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 with Priority: HIGHEST for action security_group_members [ 648.333678] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 with Priority: HIGHEST for action security_group_members [ 648.334101] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d420ce27-a76a-40c4-b871-c1f69291d3f0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.334212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.334212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.334460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.334621] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.334723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.334785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.334940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.335035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.335127] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d420ce27-a76a-40c4-b871-c1f69291d3f0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.372648] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: SUCCESS [ 648.372928] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 deletion is rescheduled due to dependency. [ 648.373052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.373213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.373687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.373811] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.373924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.373986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.374161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.374900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.374900] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.762711] env[66730]: INFO networking_nsxv3.common.synchronization [req-0bc0d260-05aa-4bc9-ab7b-5d97844ef984 req-e7b9acf0-b8be-4564-af85-3301d2a11479 tempest-ServerPasswordTestJSON-799947988 tempest-ServerPasswordTestJSON-799947988-project-member] Enqueued Resource ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 with Priority: HIGHEST for action security_group_members [ 648.763457] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 with Priority: HIGHEST for action security_group_members [ 648.764615] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.764776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.764982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.765280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.765569] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.765743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.765854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.766093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.766286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.766494] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fee2eedb-c65a-44aa-aac1-bdad7895fbe4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.838671] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.839076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.839076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.839234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.839375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.840114] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.840114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.840114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.840342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.840378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.841031] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 already deleted. [ 648.841031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.877936] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.095824] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.096765] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.098132] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.098132] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.098132] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.099987] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.099987] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.099987] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.099987] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.101042] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.101042] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.101042] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.101042] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.101042] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.101042] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.101280] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.123863] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.124261] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.124261] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.124343] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.124622] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-fdf22a2f-d317-4dd4-8f62-db1419f9270e taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.127444] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-fdf22a2f-d317-4dd4-8f62-db1419f9270e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.127444] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-fdf22a2f-d317-4dd4-8f62-db1419f9270e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.127444] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-fdf22a2f-d317-4dd4-8f62-db1419f9270e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.127444] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf22a2f-d317-4dd4-8f62-db1419f9270e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.269529] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.269790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.269863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.270094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.270191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.270392] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.270595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.270595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.270699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.270775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.270861] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 is going to be updated. [ 649.296979] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 649.298025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.298025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.298025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.298025] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.298269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.298269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.298444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.299557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.299557] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.342714] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.342846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.342889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.343250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.343403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.354370] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 in Status: IN_PROGRESS for 2s [ 649.380412] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.628501] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.628958] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.629107] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.630643] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.630643] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.630643] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port fdf22a2f-d317-4dd4-8f62-db1419f9270e not found, creating... [ 649.630865] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.631027] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.631261] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.631455] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.631955] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.631955] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.632100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.632731] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.632731] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.632731] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.632731] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: fdf22a2f-d317-4dd4-8f62-db1419f9270e is going to be created. [ 649.658310] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.658310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.658310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.658310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.658931] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.658931] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-fdf22a2f-d317-4dd4-8f62-db1419f9270e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.801992] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.885095] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.885576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.885727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.886066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.886195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.886292] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 is going to be updated. [ 649.925931] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.926202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.926202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.926484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.926719] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.938371] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: IN_PROGRESS for 2s [ 650.304328] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.386927] env[66730]: INFO networking_nsxv3.common.synchronization [req-98b490d7-9354-47a5-8f3e-ddf14c74fa5f req-111b36fd-73aa-46bd-8fa7-d88557988916 service nova] Enqueued Resource ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 with Priority: HIGHEST for action security_group_rules [ 650.387266] env[66730]: INFO networking_nsxv3.common.synchronization [req-98b490d7-9354-47a5-8f3e-ddf14c74fa5f req-111b36fd-73aa-46bd-8fa7-d88557988916 service nova] Enqueued Resource ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 with Priority: HIGHEST for action security_group_members [ 650.387266] env[66730]: INFO networking_nsxv3.common.synchronization [req-98b490d7-9354-47a5-8f3e-ddf14c74fa5f req-111b36fd-73aa-46bd-8fa7-d88557988916 service nova] Enqueued Resource ID: fdf22a2f-d317-4dd4-8f62-db1419f9270e with Priority: HIGHEST for action port [ 650.387773] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 with Priority: HIGHEST for action security_group_rules [ 650.387903] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 with Priority: HIGHEST for action security_group_members [ 650.388030] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf22a2f-d317-4dd4-8f62-db1419f9270e with Priority: HIGHEST for action port [ 650.388309] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d420ce27-a76a-40c4-b871-c1f69291d3f0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.388478] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.388553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.388812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.388893] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d420ce27-a76a-40c4-b871-c1f69291d3f0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.390064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d420ce27-a76a-40c4-b871-c1f69291d3f0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.390163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.390163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.390357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.390501] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.390596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.390659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.390801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.390895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.390961] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d420ce27-a76a-40c4-b871-c1f69291d3f0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.391716] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdf22a2f-d317-4dd4-8f62-db1419f9270e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.392111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdf22a2f-d317-4dd4-8f62-db1419f9270e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.392111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdf22a2f-d317-4dd4-8f62-db1419f9270e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.392255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdf22a2f-d317-4dd4-8f62-db1419f9270e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.392290] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf22a2f-d317-4dd4-8f62-db1419f9270e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.807244] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.807244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.807244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.807244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.807244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.807586] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be updated. [ 650.847945] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.848217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.848217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.848461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.848564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.861653] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: IN_PROGRESS for 2s [ 650.894199] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d420ce27-a76a-40c4-b871-c1f69291d3f0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.894427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.894529] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d420ce27-a76a-40c4-b871-c1f69291d3f0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.895656] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdf22a2f-d317-4dd4-8f62-db1419f9270e with status ACTIVE [ 650.895922] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.896060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.896134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.896402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.896549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.896831] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.896956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.897156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.897390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.897475] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.897954] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.897954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.897954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.897954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.898568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.898667] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdf22a2f-d317-4dd4-8f62-db1419f9270e is going to be updated. [ 650.935569] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.935739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.935810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.936010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.936144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.936302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdf22a2f-d317-4dd4-8f62-db1419f9270e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.370064] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 in Status: SUCCESS [ 651.370064] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 deletion is rescheduled due to dependency. [ 651.370064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.402088] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d420ce27-a76a-40c4-b871-c1f69291d3f0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.904825] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.904825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.904825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.905045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.905665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.905665] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 is going to be created. [ 651.935259] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.935571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.935722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.936047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.936282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.950828] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: SUCCESS [ 651.951069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.951252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.951575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.951770] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.951894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.951952] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.954923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.954923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.954923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.954923] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.958313] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 in Status: UNINITIALIZED for 2s [ 652.465987] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.465987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.465987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.465987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.465987] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.465987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.465987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.465987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.465987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.468915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.468915] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.468915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.468915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.468915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.468915] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.468915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.468915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.468915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.468915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.468915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.468915] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.876784] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 652.876784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.877072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.877497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.877710] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.877894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.878096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.878253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.878371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.878510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.878757] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.878876] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.878985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.879186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.879396] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.879550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.879659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.881909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.881909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.881909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.881909] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.881909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.881909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.881909] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.882509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.883901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.885256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.885465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.885689] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.971825] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d62c76c-0a88-45ac-87f2-2212482e3159: rpc.has_security_group_logging(os_id): False [ 652.994071] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.994247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.994306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.994543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.994648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.994875] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.994975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.995050] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.995200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.995287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.995511] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.995614] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.995676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.995844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.995922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.997789] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.997789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.997789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.997789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.998065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.998641] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 is going to be updated. [ 653.093036] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.093036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.093036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.093036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.093036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.114750] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: IN_PROGRESS for 2s [ 653.391268] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.393815] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0: rpc.has_security_group_logging(os_id): False [ 653.401812] env[66730]: INFO networking_nsxv3.common.synchronization [req-569fce48-abbc-4eb1-90f6-37735a4e902b req-6163127f-3841-4e57-9972-112ab63c4c43 tempest-ServerDiagnosticsTest-132125429 tempest-ServerDiagnosticsTest-132125429-project-member] Enqueued Resource ID: 3990207f-c264-4f81-b18d-55d8c1cd003e with Priority: HIGHEST for action security_group_members [ 653.402976] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990207f-c264-4f81-b18d-55d8c1cd003e with Priority: HIGHEST for action security_group_members [ 653.403379] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990207f-c264-4f81-b18d-55d8c1cd003e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.403527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.403600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.403923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.404106] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.404215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.404280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.404444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.404531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.404624] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990207f-c264-4f81-b18d-55d8c1cd003e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.422222] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.422747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.423284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.423753] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.423997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.424605] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.424908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.425335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.429025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.429025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.429025] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.429025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.429025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.429025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.429025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.429025] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.429025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.429025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.429025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.429025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.429025] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be created. [ 653.499314] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.499314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.499314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.499314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.499314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.517034] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: IN_PROGRESS for 2s [ 653.897472] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.908280] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.908535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.908602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.908823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.909237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.909237] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.909237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.909413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.909516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.909516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.909603] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990207f-c264-4f81-b18d-55d8c1cd003e already deleted. [ 653.909738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.971931] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 in Status: SUCCESS [ 653.972169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.972342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.972567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.972761] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.972881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.972946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.973158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.973242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.973329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.973440] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d420ce27-a76a-40c4-b871-c1f69291d3f0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.217940] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.218228] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.218352] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.218621] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.219043] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.219043] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.219217] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.219877] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.219877] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.219877] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.219877] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.219877] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.220350] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.220350] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.220350] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.220350] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.243971] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.243971] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.243971] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.243971] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.243971] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-968c7689-b5e2-47f1-b135-791e8d4256d3 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.243971] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-968c7689-b5e2-47f1-b135-791e8d4256d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.243971] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-968c7689-b5e2-47f1-b135-791e8d4256d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.243971] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-968c7689-b5e2-47f1-b135-791e8d4256d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.243971] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('968c7689-b5e2-47f1-b135-791e8d4256d3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.401863] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.402045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.402113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.402394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.402505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.402505] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be updated. [ 654.432161] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.432372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.432372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.432546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.432691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.444476] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: IN_PROGRESS for 2s [ 654.476736] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d420ce27-a76a-40c4-b871-c1f69291d3f0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.476917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.476977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.477207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.477471] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.477608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.477658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.477789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.477873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.477958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.478119] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d420ce27-a76a-40c4-b871-c1f69291d3f0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.478237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.478277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.478419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.478762] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.478914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.478995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.479201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.479254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.479335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.479438] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d420ce27-a76a-40c4-b871-c1f69291d3f0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.745633] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.745982] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.746078] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.746357] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.746512] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.746713] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 968c7689-b5e2-47f1-b135-791e8d4256d3 not found, creating... [ 654.746915] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.747081] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.747638] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.747962] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.748146] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.748704] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.748821] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.749025] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.749364] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.749550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.749751] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 968c7689-b5e2-47f1-b135-791e8d4256d3 is going to be created. [ 654.773045] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.773285] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.773378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.773776] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.773954] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.774284] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-968c7689-b5e2-47f1-b135-791e8d4256d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.982813] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d420ce27-a76a-40c4-b871-c1f69291d3f0: rpc.has_security_group_logging(os_id): False [ 655.012398] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.012398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.012398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.012398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.012398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.012398] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.012398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.012398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.012398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.012398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.013261] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.013535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.013743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.015135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.015394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.017713] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.017713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.017713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.017713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.017713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.017713] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 is going to be created. [ 655.088156] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.088156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.088156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.088539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.088669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.108564] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 in Status: IN_PROGRESS for 2s [ 655.130506] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: SUCCESS [ 655.130753] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.484364] env[66730]: INFO networking_nsxv3.common.synchronization [req-569fce48-abbc-4eb1-90f6-37735a4e902b req-70907078-941f-4120-97d3-6de23dcd0984 service nova] Enqueued Resource ID: 3990207f-c264-4f81-b18d-55d8c1cd003e with Priority: HIGHEST for action security_group_rules [ 655.484583] env[66730]: INFO networking_nsxv3.common.synchronization [req-569fce48-abbc-4eb1-90f6-37735a4e902b req-70907078-941f-4120-97d3-6de23dcd0984 service nova] Enqueued Resource ID: 3990207f-c264-4f81-b18d-55d8c1cd003e with Priority: HIGHEST for action security_group_members [ 655.484583] env[66730]: INFO networking_nsxv3.common.synchronization [req-569fce48-abbc-4eb1-90f6-37735a4e902b req-70907078-941f-4120-97d3-6de23dcd0984 service nova] Enqueued Resource ID: 968c7689-b5e2-47f1-b135-791e8d4256d3 with Priority: HIGHEST for action port [ 655.484799] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990207f-c264-4f81-b18d-55d8c1cd003e with Priority: HIGHEST for action security_group_rules [ 655.484962] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990207f-c264-4f81-b18d-55d8c1cd003e with Priority: HIGHEST for action security_group_members [ 655.484962] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 968c7689-b5e2-47f1-b135-791e8d4256d3 with Priority: HIGHEST for action port [ 655.485527] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3990207f-c264-4f81-b18d-55d8c1cd003e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.485646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.485794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.485969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.486691] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3990207f-c264-4f81-b18d-55d8c1cd003e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.488764] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990207f-c264-4f81-b18d-55d8c1cd003e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.488764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.491035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.491035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.491035] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.491035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.491035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.491035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.492141] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.492141] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990207f-c264-4f81-b18d-55d8c1cd003e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.495954] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-968c7689-b5e2-47f1-b135-791e8d4256d3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.495954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-968c7689-b5e2-47f1-b135-791e8d4256d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.495954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-968c7689-b5e2-47f1-b135-791e8d4256d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.495954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-968c7689-b5e2-47f1-b135-791e8d4256d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.495954] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('968c7689-b5e2-47f1-b135-791e8d4256d3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.532832] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 655.532947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.533333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.533603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.533723] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.000991] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990207f-c264-4f81-b18d-55d8c1cd003e taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.000991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.000991] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3990207f-c264-4f81-b18d-55d8c1cd003e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.000991] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 968c7689-b5e2-47f1-b135-791e8d4256d3 with status ACTIVE [ 656.000991] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.000991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.000991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.000991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.000991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.000991] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.000991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.000991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.000991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.000991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.001904] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.001904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.001904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.001904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.001904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.001904] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 968c7689-b5e2-47f1-b135-791e8d4256d3 is going to be updated. [ 656.026687] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.027281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.027281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.027281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.027501] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.027633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-968c7689-b5e2-47f1-b135-791e8d4256d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.035650] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.035829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.460244] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 656.460533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.460578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.460959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.461308] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.461495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.461625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.461835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.461980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.462102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.462198] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.506158] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3990207f-c264-4f81-b18d-55d8c1cd003e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.793631] env[66730]: INFO networking_nsxv3.common.synchronization [req-68cf0e05-7794-4268-b32e-1c3bcb125682 req-4eac6ecd-3712-493d-99e8-4b8985714470 tempest-ServerAddressesNegativeTestJSON-492899833 tempest-ServerAddressesNegativeTestJSON-492899833-project-member] Enqueued Resource ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b with Priority: HIGHEST for action security_group_members [ 656.794532] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b with Priority: HIGHEST for action security_group_members [ 656.795195] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.795540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.795638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.796015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.796992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.797567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.797662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.797839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.797925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.798052] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.967530] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.967728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.967776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.968041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.968268] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.968393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.968497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.968711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.968803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.968917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.969099] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.969186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.969331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.969591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.969764] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.969887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.969967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.970157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.971937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.972076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.972156] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.009398] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.009810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.009810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.009909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.010016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.010121] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990207f-c264-4f81-b18d-55d8c1cd003e is going to be created. [ 657.040035] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.040035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.040248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.040755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.040755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.055160] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990207f-c264-4f81-b18d-55d8c1cd003e in Status: UNINITIALIZED for 2s [ 657.124219] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 in Status: SUCCESS [ 657.124566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.302234] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.302234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.302234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.302234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.302234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.302234] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.302234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.302234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.302234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.302234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.302234] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b already deleted. [ 657.302234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.384195] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7f01af16-b03b-45e9-8fd8-0ac9cb57c911 None None] Enqueued Resource ID: ecf11220-a0d7-4949-8eda-6ba0204909d3 with Priority: HIGHEST for action port [ 657.384195] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf11220-a0d7-4949-8eda-6ba0204909d3 with Priority: HIGHEST for action port [ 657.384195] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecf11220-a0d7-4949-8eda-6ba0204909d3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.385932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecf11220-a0d7-4949-8eda-6ba0204909d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.386194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecf11220-a0d7-4949-8eda-6ba0204909d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.387762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecf11220-a0d7-4949-8eda-6ba0204909d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.387762] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf11220-a0d7-4949-8eda-6ba0204909d3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.475483] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0: rpc.has_security_group_logging(os_id): False [ 657.495747] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.498019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.498019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.498019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.498854] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.499090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.499788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.499788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.499788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.500022] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be updated. [ 657.578065] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.578436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.578436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.578585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.578730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.599640] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: IN_PROGRESS for 2s [ 657.844745] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.845037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-72" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.845236] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-72" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.845635] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-72" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.845980] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.846217] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.846402] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.846762] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.846969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.847308] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.847487] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.847679] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.847847] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.848029] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.848237] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.848440] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.871038] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.871207] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.871338] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.871509] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-72" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.871824] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-e89af5cc-d279-4ee3-a8ba-12c240b3b35c taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.871987] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-e89af5cc-d279-4ee3-a8ba-12c240b3b35c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.872113] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-e89af5cc-d279-4ee3-a8ba-12c240b3b35c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.872432] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-e89af5cc-d279-4ee3-a8ba-12c240b3b35c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.872567] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e89af5cc-d279-4ee3-a8ba-12c240b3b35c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.890822] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecf11220-a0d7-4949-8eda-6ba0204909d3 [ 657.891044] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.891179] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.891242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.891793] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.891893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.891995] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecf11220-a0d7-4949-8eda-6ba0204909d3 already deleted. [ 657.892091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecf11220-a0d7-4949-8eda-6ba0204909d3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.086210] env[66730]: INFO networking_nsxv3.common.synchronization [None req-a2425768-2ad3-4e0b-af9b-2f07729d2db3 None None] Enqueued Resource ID: e9d0ca1c-e9d1-43a7-9ae7-bd777f443282 with Priority: HIGHEST for action port [ 658.086210] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d0ca1c-e9d1-43a7-9ae7-bd777f443282 with Priority: HIGHEST for action port [ 658.086897] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9d0ca1c-e9d1-43a7-9ae7-bd777f443282 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.087306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9d0ca1c-e9d1-43a7-9ae7-bd777f443282" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.087580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9d0ca1c-e9d1-43a7-9ae7-bd777f443282" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.087941] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9d0ca1c-e9d1-43a7-9ae7-bd777f443282" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.088158] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9d0ca1c-e9d1-43a7-9ae7-bd777f443282',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.376208] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.376208] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.376208] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.376459] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.376603] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.376728] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port e89af5cc-d279-4ee3-a8ba-12c240b3b35c not found, creating... [ 658.377043] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.377211] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.377318] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.377670] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.377828] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.378284] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.378371] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.378467] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.378803] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.378993] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.379162] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: e89af5cc-d279-4ee3-a8ba-12c240b3b35c is going to be created. [ 658.400533] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.400780] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.401040] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.401363] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.401619] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.401871] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-e89af5cc-d279-4ee3-a8ba-12c240b3b35c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.592339] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9d0ca1c-e9d1-43a7-9ae7-bd777f443282 [ 658.592339] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.592339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.592339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.592339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.592339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.592339] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9d0ca1c-e9d1-43a7-9ae7-bd777f443282 already deleted. [ 658.592339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9d0ca1c-e9d1-43a7-9ae7-bd777f443282" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.071028] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990207f-c264-4f81-b18d-55d8c1cd003e in Status: SUCCESS [ 659.071255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.071442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.071660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.072545] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.072545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.072545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.072545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.072545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.072545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.072545] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3990207f-c264-4f81-b18d-55d8c1cd003e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.162130] env[66730]: INFO networking_nsxv3.common.synchronization [req-68cf0e05-7794-4268-b32e-1c3bcb125682 req-cb1a459a-1ec6-4dba-bd6a-6bb9319a6c1b service nova] Enqueued Resource ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b with Priority: HIGHEST for action security_group_rules [ 659.162672] env[66730]: INFO networking_nsxv3.common.synchronization [req-68cf0e05-7794-4268-b32e-1c3bcb125682 req-cb1a459a-1ec6-4dba-bd6a-6bb9319a6c1b service nova] Enqueued Resource ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b with Priority: HIGHEST for action security_group_members [ 659.162672] env[66730]: INFO networking_nsxv3.common.synchronization [req-68cf0e05-7794-4268-b32e-1c3bcb125682 req-cb1a459a-1ec6-4dba-bd6a-6bb9319a6c1b service nova] Enqueued Resource ID: e89af5cc-d279-4ee3-a8ba-12c240b3b35c with Priority: HIGHEST for action port [ 659.162963] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b with Priority: HIGHEST for action security_group_rules [ 659.166043] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b with Priority: HIGHEST for action security_group_members [ 659.166043] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e89af5cc-d279-4ee3-a8ba-12c240b3b35c with Priority: HIGHEST for action port [ 659.166043] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.166687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.166687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.166687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.166687] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.170511] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.170511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.170511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.170511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.170511] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.170511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.170511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.170511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.170511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.170511] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.170511] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e89af5cc-d279-4ee3-a8ba-12c240b3b35c taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.170511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e89af5cc-d279-4ee3-a8ba-12c240b3b35c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.170511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e89af5cc-d279-4ee3-a8ba-12c240b3b35c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.171602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e89af5cc-d279-4ee3-a8ba-12c240b3b35c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.171602] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e89af5cc-d279-4ee3-a8ba-12c240b3b35c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.578440] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990207f-c264-4f81-b18d-55d8c1cd003e taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.578440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.578440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.578440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.578894] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.578894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.578894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.578894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.578894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.579170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.579170] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990207f-c264-4f81-b18d-55d8c1cd003e taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.579262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.579300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.579539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.579625] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.579759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.579759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.579899] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.580070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.580070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.580155] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3990207f-c264-4f81-b18d-55d8c1cd003e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.614212] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 659.614436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.614762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.614872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.614961] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.648313] env[66730]: INFO networking_nsxv3.common.synchronization [req-a11140d2-b568-49f6-ad31-4e9669e2ed5c req-42b16a25-e9de-420a-9674-c800c5eae398 tempest-InstanceActionsNegativeTestJSON-2074973011 tempest-InstanceActionsNegativeTestJSON-2074973011-project-member] Enqueued Resource ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 with Priority: HIGHEST for action security_group_members [ 659.649470] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 with Priority: HIGHEST for action security_group_members [ 659.649470] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca41c1b-622d-4ab6-868b-84dca5e38456 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.649470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.649470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.649804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.650234] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.650234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.650234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.650802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.650802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.650802] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ca41c1b-622d-4ab6-868b-84dca5e38456',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.674427] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.674427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.674427] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.674953] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e89af5cc-d279-4ee3-a8ba-12c240b3b35c with status ACTIVE [ 659.674953] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.674953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.674953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.676144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.676144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.676144] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.676144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.676144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.676144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.676144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.676144] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.676144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.676144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.678533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.678533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.678533] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e89af5cc-d279-4ee3-a8ba-12c240b3b35c is going to be updated. [ 659.701486] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.701640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.701748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.701921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.702066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.702232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e89af5cc-d279-4ee3-a8ba-12c240b3b35c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.841374] env[66730]: INFO networking_nsxv3.common.synchronization [None req-eb6f9f04-e873-47ee-b8ec-5eaf02f2a24b None None] Enqueued Resource ID: 991bc2c8-c42b-4d45-9d58-34600adf8c90 with Priority: HIGHEST for action port [ 659.842029] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 991bc2c8-c42b-4d45-9d58-34600adf8c90 with Priority: HIGHEST for action port [ 659.842814] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-991bc2c8-c42b-4d45-9d58-34600adf8c90 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.843109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-991bc2c8-c42b-4d45-9d58-34600adf8c90" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.843109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-991bc2c8-c42b-4d45-9d58-34600adf8c90" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.843317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-991bc2c8-c42b-4d45-9d58-34600adf8c90" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.843401] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('991bc2c8-c42b-4d45-9d58-34600adf8c90',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.056069] env[66730]: INFO networking_nsxv3.common.synchronization [None req-ff2dd757-b7ab-4162-a629-5812d727d2f8 None None] Enqueued Resource ID: 734b1125-6f03-4c97-b311-263eeb5a23fe with Priority: HIGHEST for action port [ 660.056694] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734b1125-6f03-4c97-b311-263eeb5a23fe with Priority: HIGHEST for action port [ 660.059972] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-734b1125-6f03-4c97-b311-263eeb5a23fe taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.060235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-734b1125-6f03-4c97-b311-263eeb5a23fe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.060354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-734b1125-6f03-4c97-b311-263eeb5a23fe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.060740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-734b1125-6f03-4c97-b311-263eeb5a23fe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.060975] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('734b1125-6f03-4c97-b311-263eeb5a23fe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.085499] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3990207f-c264-4f81-b18d-55d8c1cd003e: rpc.has_security_group_logging(os_id): False [ 660.107468] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.107702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.107783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.108030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.108126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.108403] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.108535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.108600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.108763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.108847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.109064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.109195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.109273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.109413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.109495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.109697] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.109791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.109853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.110043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.110124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.110214] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3990207f-c264-4f81-b18d-55d8c1cd003e is going to be created. [ 660.120027] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.120027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.120027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.120027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.120027] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.120027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.120027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.120027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.120027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.120027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.120027] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.132879] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-639 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.132879] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-639" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.132879] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-639" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.132879] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-639" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.134016] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.134244] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.134419] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.134706] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.134880] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.135169] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.136937] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.137086] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.137221] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.137365] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.137608] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.137819] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.153913] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.154125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.154179] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.154419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.154460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.155527] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.155527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.155527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.155527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.155527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.155527] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 already deleted. [ 660.155527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.159511] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.159682] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.159811] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.160026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-639" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.160336] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-80689a7b-b552-4dc4-936d-4aeb5c8647b9 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.160502] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-80689a7b-b552-4dc4-936d-4aeb5c8647b9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.160614] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-80689a7b-b552-4dc4-936d-4aeb5c8647b9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.160910] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-80689a7b-b552-4dc4-936d-4aeb5c8647b9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.161053] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80689a7b-b552-4dc4-936d-4aeb5c8647b9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.179170] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.189070] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.189307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.189307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.189589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.189781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.205359] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990207f-c264-4f81-b18d-55d8c1cd003e in Status: IN_PROGRESS for 2s [ 660.346109] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 991bc2c8-c42b-4d45-9d58-34600adf8c90 [ 660.346523] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.346694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.346769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.347037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.347125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.347242] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:991bc2c8-c42b-4d45-9d58-34600adf8c90 already deleted. [ 660.347858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-991bc2c8-c42b-4d45-9d58-34600adf8c90" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.567902] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 734b1125-6f03-4c97-b311-263eeb5a23fe [ 660.568172] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.568312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.568443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.568642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.568740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.568844] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:734b1125-6f03-4c97-b311-263eeb5a23fe already deleted. [ 660.568929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-734b1125-6f03-4c97-b311-263eeb5a23fe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.627047] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.627047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.627047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.627314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.627314] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.627460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.627530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.627723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.627831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.627933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.628100] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.628208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.628270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.628415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.628576] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.628672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.628750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.628907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.628988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.630240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.630240] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.666859] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.667188] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.667337] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.667792] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.667961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.668194] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 80689a7b-b552-4dc4-936d-4aeb5c8647b9 not found, creating... [ 660.668606] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.668790] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.668940] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.669506] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.670086] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.670300] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.670491] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.670682] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.670964] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.671796] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.671796] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 80689a7b-b552-4dc4-936d-4aeb5c8647b9 is going to be created. [ 660.684455] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.684721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.684721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.684932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.685102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.685220] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b is going to be created. [ 660.714580] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.714852] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.715042] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.715347] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.715769] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.716226] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-80689a7b-b552-4dc4-936d-4aeb5c8647b9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.737689] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.737860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.737909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.738180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.738340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.763578] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b in Status: UNINITIALIZED for 2s [ 661.132546] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0: rpc.has_security_group_logging(os_id): False [ 661.154595] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.154769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.154817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.155037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.155134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.155392] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.155601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.155728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.156049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.156160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.156348] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.156476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.156569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.156753] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.156847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.157134] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.157239] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.157603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.157603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.157603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.158190] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be updated. [ 661.225762] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.225762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.226166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.226166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.226242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.250176] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: IN_PROGRESS for 2s [ 661.455549] env[66730]: INFO networking_nsxv3.common.synchronization [req-a11140d2-b568-49f6-ad31-4e9669e2ed5c req-911374c7-d886-41b9-9c69-34aa8769396f service nova] Enqueued Resource ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 with Priority: HIGHEST for action security_group_rules [ 661.455549] env[66730]: INFO networking_nsxv3.common.synchronization [req-a11140d2-b568-49f6-ad31-4e9669e2ed5c req-911374c7-d886-41b9-9c69-34aa8769396f service nova] Enqueued Resource ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 with Priority: HIGHEST for action security_group_members [ 661.455549] env[66730]: INFO networking_nsxv3.common.synchronization [req-a11140d2-b568-49f6-ad31-4e9669e2ed5c req-911374c7-d886-41b9-9c69-34aa8769396f service nova] Enqueued Resource ID: 80689a7b-b552-4dc4-936d-4aeb5c8647b9 with Priority: HIGHEST for action port [ 661.458883] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 with Priority: HIGHEST for action security_group_rules [ 661.458883] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 with Priority: HIGHEST for action security_group_members [ 661.458883] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80689a7b-b552-4dc4-936d-4aeb5c8647b9 with Priority: HIGHEST for action port [ 661.458883] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ca41c1b-622d-4ab6-868b-84dca5e38456 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.459241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.459241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.459354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.459396] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ca41c1b-622d-4ab6-868b-84dca5e38456',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.462897] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca41c1b-622d-4ab6-868b-84dca5e38456 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.462897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.462897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.462897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.462897] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.462897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.462897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.463375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.463375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.463375] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ca41c1b-622d-4ab6-868b-84dca5e38456',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.464923] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-80689a7b-b552-4dc4-936d-4aeb5c8647b9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.464923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80689a7b-b552-4dc4-936d-4aeb5c8647b9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.464923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80689a7b-b552-4dc4-936d-4aeb5c8647b9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.464923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80689a7b-b552-4dc4-936d-4aeb5c8647b9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.465191] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80689a7b-b552-4dc4-936d-4aeb5c8647b9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.966924] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca41c1b-622d-4ab6-868b-84dca5e38456 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.970485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.970485] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ca41c1b-622d-4ab6-868b-84dca5e38456',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.970842] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80689a7b-b552-4dc4-936d-4aeb5c8647b9 with status ACTIVE [ 661.972143] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.972143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.972143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.972143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.972143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.972143] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.972143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.972143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.972143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.972604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.972604] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.972604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.972711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.973612] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.973612] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.973612] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80689a7b-b552-4dc4-936d-4aeb5c8647b9 is going to be updated. [ 661.998037] env[66730]: INFO networking_nsxv3.common.synchronization [req-8d19ea98-67de-44e3-aab6-d3feab5d10d3 req-15f64cb9-d357-4ac6-9f2a-37c823d70a05 tempest-ListServerFiltersTestJSON-701955747 tempest-ListServerFiltersTestJSON-701955747-project-member] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 661.999971] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.000779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.000779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.000779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.000779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.001206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80689a7b-b552-4dc4-936d-4aeb5c8647b9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.001694] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 662.002522] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.002717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.002717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.002717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.003272] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.003410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.003504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.003691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.003813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.003966] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.217882] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990207f-c264-4f81-b18d-55d8c1cd003e in Status: SUCCESS [ 662.218149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.476728] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ca41c1b-622d-4ab6-868b-84dca5e38456',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.509311] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.509311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.509311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.509311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.509311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.509311] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.509311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.509311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.509311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.509311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.509311] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 already deleted. [ 662.509311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.585789] env[66730]: INFO networking_nsxv3.common.synchronization [None req-ded4ce5c-9823-456a-a751-d0e5bf08d366 None None] Enqueued Resource ID: a7cb1f48-4593-40c8-8af1-316265b9bf7b with Priority: HIGHEST for action port [ 662.586016] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7cb1f48-4593-40c8-8af1-316265b9bf7b with Priority: HIGHEST for action port [ 662.586326] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7cb1f48-4593-40c8-8af1-316265b9bf7b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.586625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7cb1f48-4593-40c8-8af1-316265b9bf7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.586712] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7cb1f48-4593-40c8-8af1-316265b9bf7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.587014] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7cb1f48-4593-40c8-8af1-316265b9bf7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.587105] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7cb1f48-4593-40c8-8af1-316265b9bf7b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.795158] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b in Status: SUCCESS [ 662.795158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.795158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.795158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.795158] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.795158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.795158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.795158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.795158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.795158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.795158] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.961503] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.961503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.961503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.961503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.961798] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.961798] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.961900] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.962095] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.962795] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.962795] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.962795] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.962795] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.962795] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.962795] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.963165] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.963165] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.979242] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.979352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.979352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.979580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.979704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.979825] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 is going to be created. [ 662.988065] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.988240] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.988370] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.988541] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.988881] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-e42fb582-0ce7-479c-86a9-37552d185fb9 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.989030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-e42fb582-0ce7-479c-86a9-37552d185fb9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.989142] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-e42fb582-0ce7-479c-86a9-37552d185fb9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.989468] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-e42fb582-0ce7-479c-86a9-37552d185fb9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.989598] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e42fb582-0ce7-479c-86a9-37552d185fb9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.010730] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.010730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.010730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.010730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.010730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.024038] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 in Status: UNINITIALIZED for 2s [ 663.090104] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7cb1f48-4593-40c8-8af1-316265b9bf7b [ 663.090317] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.090419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.090472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.090688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.090781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.090875] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7cb1f48-4593-40c8-8af1-316265b9bf7b already deleted. [ 663.090955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7cb1f48-4593-40c8-8af1-316265b9bf7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.273897] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 663.274057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.291212] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.291433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.291433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.292917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.292917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.292917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.292917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.293576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.293576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.293576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.293576] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.491973] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.492325] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.492325] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.492570] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.492655] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.492796] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port e42fb582-0ce7-479c-86a9-37552d185fb9 not found, creating... [ 663.493055] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.493204] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.493313] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.493627] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.493695] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.493905] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.494118] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.494173] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.494354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.494496] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.494864] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: e42fb582-0ce7-479c-86a9-37552d185fb9 is going to be created. [ 663.515654] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.515969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.516146] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.516527] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.516829] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.517163] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-e42fb582-0ce7-479c-86a9-37552d185fb9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.799082] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b: rpc.has_security_group_logging(os_id): False [ 663.831961] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.832762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.832762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.833010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.833127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.833420] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.833487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.833561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.833848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.833915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.834148] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.834279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.834348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.834546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.834770] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.834880] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.835009] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.835098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.835286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.835373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.835495] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b is going to be created. [ 663.919867] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.920091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.920091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.920311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.920486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.937983] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b in Status: IN_PROGRESS for 2s [ 664.007793] env[66730]: INFO networking_nsxv3.common.synchronization [req-b93038c3-dc58-454c-b0e5-5d1ca9b6a933 req-b3c0b1fc-8930-41c7-9d45-331873b47b88 tempest-ImagesOneServerTestJSON-997968893 tempest-ImagesOneServerTestJSON-997968893-project-member] Enqueued Resource ID: a985d046-799d-4d0f-ae02-11071c04b015 with Priority: HIGHEST for action security_group_members [ 664.008404] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a985d046-799d-4d0f-ae02-11071c04b015 with Priority: HIGHEST for action security_group_members [ 664.008769] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a985d046-799d-4d0f-ae02-11071c04b015 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.008917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.008992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.009468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.009719] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.009904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.010284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.010547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.010676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.010825] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a985d046-799d-4d0f-ae02-11071c04b015',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.281403] env[66730]: INFO networking_nsxv3.common.synchronization [req-8d19ea98-67de-44e3-aab6-d3feab5d10d3 req-7b7375e5-12ce-490c-b1ec-0ecd5ca47843 service nova] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_rules [ 664.283025] env[66730]: INFO networking_nsxv3.common.synchronization [req-8d19ea98-67de-44e3-aab6-d3feab5d10d3 req-7b7375e5-12ce-490c-b1ec-0ecd5ca47843 service nova] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 664.283025] env[66730]: INFO networking_nsxv3.common.synchronization [req-8d19ea98-67de-44e3-aab6-d3feab5d10d3 req-7b7375e5-12ce-490c-b1ec-0ecd5ca47843 service nova] Enqueued Resource ID: e42fb582-0ce7-479c-86a9-37552d185fb9 with Priority: HIGHEST for action port [ 664.283025] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_rules [ 664.283793] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 664.284124] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42fb582-0ce7-479c-86a9-37552d185fb9 with Priority: HIGHEST for action port [ 664.285638] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.285638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.285638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.285638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.285963] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.287355] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.288016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.288016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.288016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.289233] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.293025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.293025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.293025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.293025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.293025] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.293025] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e42fb582-0ce7-479c-86a9-37552d185fb9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.293025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e42fb582-0ce7-479c-86a9-37552d185fb9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.293025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e42fb582-0ce7-479c-86a9-37552d185fb9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.293025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e42fb582-0ce7-479c-86a9-37552d185fb9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.293025] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e42fb582-0ce7-479c-86a9-37552d185fb9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.501940] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-326 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.502459] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-326" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.502459] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-326" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.502845] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-326" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.506542] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.506743] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.506895] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.507167] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.507283] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.507525] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.507644] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.507751] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.507847] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.507962] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.508056] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.508183] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.515731] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.515731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.515731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.515731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.515731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.515731] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.515731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.516319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.516571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.516668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.517050] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a985d046-799d-4d0f-ae02-11071c04b015 already deleted. [ 664.517050] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.533080] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.533292] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.533421] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.533609] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-326" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.533919] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-9a24d015-f696-43a7-ae94-003d20c1e3b4 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.534104] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-9a24d015-f696-43a7-ae94-003d20c1e3b4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.534216] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-9a24d015-f696-43a7-ae94-003d20c1e3b4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.534594] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-9a24d015-f696-43a7-ae94-003d20c1e3b4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.535472] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a24d015-f696-43a7-ae94-003d20c1e3b4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.793749] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.793933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.794186] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.796119] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e42fb582-0ce7-479c-86a9-37552d185fb9 with status ACTIVE [ 664.798642] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.798642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.798642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.798642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.798642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.798642] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.798642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.798642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.798642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.798642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.799575] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.799575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.799575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.799781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.799781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.800058] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e42fb582-0ce7-479c-86a9-37552d185fb9 is going to be updated. [ 664.824977] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.824977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.824977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.824977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.825369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.825369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e42fb582-0ce7-479c-86a9-37552d185fb9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.860958] env[66730]: INFO networking_nsxv3.common.synchronization [None req-2abf3760-78b1-4410-b9e1-eca453e9a9e5 None None] Enqueued Resource ID: 893195e5-0361-4823-bee2-94b81275fb33 with Priority: HIGHEST for action port [ 664.860958] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893195e5-0361-4823-bee2-94b81275fb33 with Priority: HIGHEST for action port [ 664.860958] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-893195e5-0361-4823-bee2-94b81275fb33 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.862097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-893195e5-0361-4823-bee2-94b81275fb33" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.862097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-893195e5-0361-4823-bee2-94b81275fb33" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.862097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-893195e5-0361-4823-bee2-94b81275fb33" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.862097] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('893195e5-0361-4823-bee2-94b81275fb33',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.036603] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 in Status: SUCCESS [ 665.036603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.036603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.036603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.036603] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.036603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.036603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.036603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.036603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.036603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.036603] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ca41c1b-622d-4ab6-868b-84dca5e38456',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.038791] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.039725] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.041823] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.041823] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.041823] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.048037] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 9a24d015-f696-43a7-ae94-003d20c1e3b4 not found, creating... [ 665.048037] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.048037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.048037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.048037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.048037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.048037] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.048037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.048037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.048037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.048703] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.048703] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 9a24d015-f696-43a7-ae94-003d20c1e3b4 is going to be created. [ 665.069188] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.069532] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.069686] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.070488] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.071079] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.071270] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-9a24d015-f696-43a7-ae94-003d20c1e3b4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.296671] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.364219] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 893195e5-0361-4823-bee2-94b81275fb33 [ 665.364526] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.364638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.364680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.364864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.364950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.365057] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:893195e5-0361-4823-bee2-94b81275fb33 already deleted. [ 665.365136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-893195e5-0361-4823-bee2-94b81275fb33" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.549036] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca41c1b-622d-4ab6-868b-84dca5e38456 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.549036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.549036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.549036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.549517] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.549517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.549517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.549517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.549688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.549730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.549882] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca41c1b-622d-4ab6-868b-84dca5e38456 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.549994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.550198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.550198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.550369] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.550443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.550484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.550647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.550723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.550762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.550842] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ca41c1b-622d-4ab6-868b-84dca5e38456',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.800063] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.800063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.800063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.800063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.800063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.800063] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be created. [ 665.815863] env[66730]: INFO networking_nsxv3.common.synchronization [req-b93038c3-dc58-454c-b0e5-5d1ca9b6a933 req-677d77c1-bea9-42b3-a396-4af940eb15bc service nova] Enqueued Resource ID: a985d046-799d-4d0f-ae02-11071c04b015 with Priority: HIGHEST for action security_group_rules [ 665.816067] env[66730]: INFO networking_nsxv3.common.synchronization [req-b93038c3-dc58-454c-b0e5-5d1ca9b6a933 req-677d77c1-bea9-42b3-a396-4af940eb15bc service nova] Enqueued Resource ID: a985d046-799d-4d0f-ae02-11071c04b015 with Priority: HIGHEST for action security_group_members [ 665.816202] env[66730]: INFO networking_nsxv3.common.synchronization [req-b93038c3-dc58-454c-b0e5-5d1ca9b6a933 req-677d77c1-bea9-42b3-a396-4af940eb15bc service nova] Enqueued Resource ID: 9a24d015-f696-43a7-ae94-003d20c1e3b4 with Priority: HIGHEST for action port [ 665.816765] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a985d046-799d-4d0f-ae02-11071c04b015 with Priority: HIGHEST for action security_group_rules [ 665.816919] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a985d046-799d-4d0f-ae02-11071c04b015 with Priority: HIGHEST for action security_group_members [ 665.817078] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a24d015-f696-43a7-ae94-003d20c1e3b4 with Priority: HIGHEST for action port [ 665.817902] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a985d046-799d-4d0f-ae02-11071c04b015 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.817902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.818376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.818376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.818376] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a985d046-799d-4d0f-ae02-11071c04b015',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.819973] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a985d046-799d-4d0f-ae02-11071c04b015 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.819973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.819973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.819973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.819973] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.819973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.819973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.824101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.824101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.824239] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a985d046-799d-4d0f-ae02-11071c04b015',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.827378] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a24d015-f696-43a7-ae94-003d20c1e3b4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.827615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a24d015-f696-43a7-ae94-003d20c1e3b4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.827708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a24d015-f696-43a7-ae94-003d20c1e3b4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.828178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a24d015-f696-43a7-ae94-003d20c1e3b4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.828178] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a24d015-f696-43a7-ae94-003d20c1e3b4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.845669] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.845669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.845669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.845669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.845669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.859660] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: UNINITIALIZED for 2s [ 665.952718] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b in Status: SUCCESS [ 665.953843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.052750] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ca41c1b-622d-4ab6-868b-84dca5e38456: rpc.has_security_group_logging(os_id): False [ 666.071318] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.071514] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.071514] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.071688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.071807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.072061] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.072184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.072242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.072406] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.072491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.072666] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.072771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.072962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.073313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.073399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.073610] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.073727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.073796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.073899] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.073975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.074069] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 is going to be created. [ 666.134564] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.134990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.134990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.135309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.135637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.149937] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 in Status: IN_PROGRESS for 2s [ 666.330070] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a985d046-799d-4d0f-ae02-11071c04b015 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.330326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.330456] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a985d046-799d-4d0f-ae02-11071c04b015',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.331471] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a24d015-f696-43a7-ae94-003d20c1e3b4 with status ACTIVE [ 666.331666] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.331890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.331962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.332193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.332283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.332691] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.332816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.332865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.333035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.333131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.333377] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.333555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.333635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.333803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.333887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.333975] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a24d015-f696-43a7-ae94-003d20c1e3b4 is going to be updated. [ 666.366895] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.367061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.367165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.367380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.367666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.367815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a24d015-f696-43a7-ae94-003d20c1e3b4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.836427] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a985d046-799d-4d0f-ae02-11071c04b015',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.952104] env[66730]: INFO networking_nsxv3.common.synchronization [None req-c75b2347-35ec-4f40-b925-cc94a3dad9d2 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_rules [ 666.952959] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_rules [ 666.953714] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.953848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.953969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.954279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.954369] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.062814] env[66730]: INFO networking_nsxv3.common.synchronization [None req-1e467ebd-6be5-4ee9-87f7-db4301efa715 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_rules [ 667.063383] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_rules [ 667.063680] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.063840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.339773] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.340036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.340125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.340507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.340507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.340644] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a985d046-799d-4d0f-ae02-11071c04b015 is going to be created. [ 667.369600] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.369754] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.369831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.370195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.370266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.384068] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a985d046-799d-4d0f-ae02-11071c04b015 in Status: UNINITIALIZED for 2s [ 667.476591] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.476818] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.476940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.477266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.477388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.477533] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 already deleted. [ 667.477643] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.477809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.477981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.478079] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.870864] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 667.871192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.871347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.871508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.871880] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.871977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.872083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.872356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.872356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.872463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.872545] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.012189] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.012732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.014022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.014022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.014022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.014022] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 already deleted. [ 668.014022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.166998] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 in Status: SUCCESS [ 668.168333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.375700] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.375809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.375850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.376101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.376273] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.376376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.376456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.376690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.376783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.376872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.377035] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.377129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.377188] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.377329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.377563] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.377656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.377697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.377815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.377890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.377971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.378087] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.883787] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a03f84a-bddc-4833-9f99-c1dc77481962: rpc.has_security_group_logging(os_id): False [ 668.904915] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.905105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.905105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.905316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.905438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.905847] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.905847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.905847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.905995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.906066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.906263] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.906337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.906390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.906533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.906699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.906919] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.906919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.906919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.908477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.908630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.908705] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be created. [ 668.971747] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.971930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.971992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.972212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.972389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.987817] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 669.250734] env[66730]: INFO networking_nsxv3.common.synchronization [req-07edfaf5-d46e-44b4-bb46-4602b3a4533e req-d246c227-a8f1-44df-891b-9a44992d19f6 tempest-ServersV294TestFqdnHostnames-1063815950 tempest-ServersV294TestFqdnHostnames-1063815950-project-member] Enqueued Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_members [ 669.254080] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 with Priority: HIGHEST for action security_group_members [ 669.254080] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.254080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.254080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.254080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.254080] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.254080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.254080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.254080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.254080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.254080] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4a2ee9-9ce1-46d2-900e-714dc4569d58',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.397158] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a985d046-799d-4d0f-ae02-11071c04b015 in Status: SUCCESS [ 669.397158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.397158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.397158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.397158] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.397158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.397158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.397158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.397158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.397158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.397158] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a985d046-799d-4d0f-ae02-11071c04b015',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.756619] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.757057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.757057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.757289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.757356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.757904] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.757904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.757904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.758202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.758202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.758313] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 is going to be updated. [ 669.815372] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.815769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.815877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.816106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.816256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.833295] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 in Status: IN_PROGRESS for 2s [ 669.899509] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a985d046-799d-4d0f-ae02-11071c04b015 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.899959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.899959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.900135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.901239] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.901808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.901916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.904236] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a985d046-799d-4d0f-ae02-11071c04b015 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.904236] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.904236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.904236] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a985d046-799d-4d0f-ae02-11071c04b015',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.408998] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a985d046-799d-4d0f-ae02-11071c04b015: rpc.has_security_group_logging(os_id): False [ 670.431151] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.431151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.431151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.431151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.431151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.431151] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.431151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.431151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.431151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.431151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.431151] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.431151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.431151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.432225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.432225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.432225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.432225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.432225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.432225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.432225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.432225] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a985d046-799d-4d0f-ae02-11071c04b015 is going to be created. [ 670.498354] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.498354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.498586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.498718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.498906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.511598] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a985d046-799d-4d0f-ae02-11071c04b015 in Status: IN_PROGRESS for 2s [ 671.004557] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 671.004557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.846357] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 in Status: SUCCESS [ 671.846692] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4a2ee9-9ce1-46d2-900e-714dc4569d58 deletion is rescheduled due to dependency. [ 671.846811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4a2ee9-9ce1-46d2-900e-714dc4569d58" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.029525] env[66730]: INFO networking_nsxv3.common.synchronization [req-5275245d-ffca-4eec-954a-98ea01cbf9f3 req-55ddb1a4-c628-4897-a00c-7f0fa7bd1851 tempest-ImagesOneServerNegativeTestJSON-160835856 tempest-ImagesOneServerNegativeTestJSON-160835856-project-member] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 672.030750] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 672.030750] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.030750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.030750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.031128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.031128] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.031253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.031253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.031380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.031442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.031523] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.496302] env[66730]: INFO networking_nsxv3.common.synchronization [req-9cf3324c-2786-42a8-8999-1250937e27e5 req-fe34847e-e6ee-409e-b7a8-1db77bbd414d tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 672.496946] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 672.497260] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.497780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.497865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.498217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.498394] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.498537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.498611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.498798] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.498904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.499008] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.529341] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a985d046-799d-4d0f-ae02-11071c04b015 in Status: SUCCESS [ 672.529341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.534703] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.535389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.535389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.535389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.535389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.536040] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.536165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.536206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.536687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.536687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.536957] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be updated. [ 672.588216] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.588377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.588923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.588923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.588923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.606664] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: IN_PROGRESS for 2s [ 672.872085] env[66730]: INFO networking_nsxv3.common.synchronization [req-6d59cf19-4f21-447a-bc7b-55aa4c01fdb8 req-552dcec7-6f25-4c61-bf09-0ea7f7027ce5 tempest-ListServersNegativeTestJSON-1736181721 tempest-ListServersNegativeTestJSON-1736181721-project-member] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 672.872085] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 672.872085] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.872085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.872493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.872493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.872493] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.872721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.872721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.873657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.873657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.873657] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.001185] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.001334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.001334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.002080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.002080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.002353] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.002437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.002484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.003108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.003108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.003108] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 already deleted. [ 673.003108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.264020] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.264697] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.264697] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.264697] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.265860] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.266039] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.266371] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.266493] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.266580] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.266798] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.266911] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.267023] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.267169] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.267308] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.267418] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.267839] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.294983] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.295173] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 673.295287] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.295610] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.296131] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-64638099-ede3-4858-915b-7980b441255c taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.296342] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-64638099-ede3-4858-915b-7980b441255c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.296483] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-64638099-ede3-4858-915b-7980b441255c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.296816] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-64638099-ede3-4858-915b-7980b441255c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.297009] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64638099-ede3-4858-915b-7980b441255c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.376554] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.531769] env[66730]: INFO networking_nsxv3.common.synchronization [None req-437b3896-08ae-4932-b2ac-7dbfa2e634d5 None None] Enqueued Resource ID: 303b7504-853b-49ae-97cc-4153159ff5c3 with Priority: HIGHEST for action port [ 673.532402] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 303b7504-853b-49ae-97cc-4153159ff5c3 with Priority: HIGHEST for action port [ 673.532797] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-303b7504-853b-49ae-97cc-4153159ff5c3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.532967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-303b7504-853b-49ae-97cc-4153159ff5c3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.533206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-303b7504-853b-49ae-97cc-4153159ff5c3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.533557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-303b7504-853b-49ae-97cc-4153159ff5c3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.533679] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('303b7504-853b-49ae-97cc-4153159ff5c3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.800045] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.800312] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.800512] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.800794] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.800965] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.801164] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 64638099-ede3-4858-915b-7980b441255c not found, creating... [ 673.801441] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.802245] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.802245] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.802245] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.802245] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.802555] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.802724] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.802872] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.803378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.803378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.803546] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 64638099-ede3-4858-915b-7980b441255c is going to be created. [ 673.830349] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.830555] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.830671] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.830968] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.831224] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.831439] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-64638099-ede3-4858-915b-7980b441255c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.878531] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.038936] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 303b7504-853b-49ae-97cc-4153159ff5c3 [ 674.039278] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.039424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.039491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.039720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.039813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.039928] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:303b7504-853b-49ae-97cc-4153159ff5c3 already deleted. [ 674.040017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-303b7504-853b-49ae-97cc-4153159ff5c3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.381328] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.381873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.381873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.381873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.381873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.382080] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be updated. [ 674.413790] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.413926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.414013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.414246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.414384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.427485] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: IN_PROGRESS for 2s [ 674.622969] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: SUCCESS [ 674.623503] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a deletion is rescheduled due to dependency. [ 674.623653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.661260] env[66730]: INFO networking_nsxv3.common.synchronization [req-9cf3324c-2786-42a8-8999-1250937e27e5 req-e88e9ca9-7431-45ae-9847-f67176e54fdb service nova] Enqueued Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_rules [ 674.661260] env[66730]: INFO networking_nsxv3.common.synchronization [req-9cf3324c-2786-42a8-8999-1250937e27e5 req-e88e9ca9-7431-45ae-9847-f67176e54fdb service nova] Enqueued Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 674.661260] env[66730]: INFO networking_nsxv3.common.synchronization [req-9cf3324c-2786-42a8-8999-1250937e27e5 req-e88e9ca9-7431-45ae-9847-f67176e54fdb service nova] Enqueued Resource ID: 64638099-ede3-4858-915b-7980b441255c with Priority: HIGHEST for action port [ 674.661260] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_rules [ 674.661260] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 674.661260] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64638099-ede3-4858-915b-7980b441255c with Priority: HIGHEST for action port [ 674.662440] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.662595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.662665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.662906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.663015] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.665123] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.665255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.665326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.665514] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.666245] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.666347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.666411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.666586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.666651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.666739] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.667542] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-64638099-ede3-4858-915b-7980b441255c taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.667682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64638099-ede3-4858-915b-7980b441255c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.667780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64638099-ede3-4858-915b-7980b441255c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.668022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64638099-ede3-4858-915b-7980b441255c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.668062] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64638099-ede3-4858-915b-7980b441255c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.887262] env[66730]: INFO networking_nsxv3.common.synchronization [req-7774d589-9089-4f49-aeee-499bafb24988 req-6d15f505-1107-47e6-8552-788eb2c1f1c9 tempest-ServerDiagnosticsNegativeTest-1449471440 tempest-ServerDiagnosticsNegativeTest-1449471440-project-member] Enqueued Resource ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 with Priority: HIGHEST for action security_group_members [ 674.887905] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 with Priority: HIGHEST for action security_group_members [ 674.888225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d420ce27-a76a-40c4-b871-c1f69291d3f0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.889020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.889020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.889020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.889020] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.889020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.889020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.889312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.889312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.889312] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d420ce27-a76a-40c4-b871-c1f69291d3f0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.923397] env[66730]: INFO networking_nsxv3.common.synchronization [req-86652d60-26a2-4589-9782-3fa1dd45ee47 req-ab8bbb92-7edf-48b1-9971-bc52ad428fdd tempest-ListServerFiltersTestJSON-701955747 tempest-ListServerFiltersTestJSON-701955747-project-member] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 674.924321] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 674.924666] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.924857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.924964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.925236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.925392] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.925501] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.925577] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.925733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.925816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.925909] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.172254] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.172254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.172762] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.173561] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64638099-ede3-4858-915b-7980b441255c with status ACTIVE [ 675.173718] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.173875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.173925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.175677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.175677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.175677] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.175677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.175677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.175677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.175677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.175677] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.175677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.175677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.175677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.175677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.176314] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64638099-ede3-4858-915b-7980b441255c is going to be updated. [ 675.200713] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.200862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.200984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.201287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.201472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.201708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64638099-ede3-4858-915b-7980b441255c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.211470] env[66730]: INFO networking_nsxv3.common.synchronization [req-98ddc5b4-70d8-43cd-b154-ca5e93db74ea req-8f4286d5-92bc-4bc8-9103-36e053be6bf5 tempest-FloatingIPsAssociationTestJSON-1582201638 tempest-FloatingIPsAssociationTestJSON-1582201638-project-member] Enqueued Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 675.212368] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 675.212683] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.212864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.212981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.213647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.213647] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.213647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.213647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.213838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.213838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.213838] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.391967] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.392353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.392353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.392439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.393439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.393439] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.393439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.393439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.393439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.393439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.393439] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 is going to be updated. [ 675.426854] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.427082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.427195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.427854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.428075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.429855] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.442416] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 in Status: IN_PROGRESS for 2s [ 675.678205] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.689346] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.689485] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.689485] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.689774] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.690058] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.690210] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.690400] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.690527] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.690675] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.690854] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.690960] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.691897] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.692522] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.692522] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.692522] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.692777] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.712626] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.712783] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.712972] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.713150] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.713472] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-4f1597b2-46bd-41d1-a992-d4a6ffd289bf taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.713627] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-4f1597b2-46bd-41d1-a992-d4a6ffd289bf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.713739] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-4f1597b2-46bd-41d1-a992-d4a6ffd289bf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.714069] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-4f1597b2-46bd-41d1-a992-d4a6ffd289bf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.714228] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f1597b2-46bd-41d1-a992-d4a6ffd289bf',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.718230] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.862026] env[66730]: INFO networking_nsxv3.common.synchronization [None req-861f1559-0d4b-4d7f-9674-29026e2cab6b None None] Enqueued Resource ID: 5a0af91f-7a9a-428e-8f4e-30a36c587499 with Priority: HIGHEST for action port [ 675.862026] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a0af91f-7a9a-428e-8f4e-30a36c587499 with Priority: HIGHEST for action port [ 675.862026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a0af91f-7a9a-428e-8f4e-30a36c587499 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.862026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a0af91f-7a9a-428e-8f4e-30a36c587499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.862026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a0af91f-7a9a-428e-8f4e-30a36c587499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.862026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a0af91f-7a9a-428e-8f4e-30a36c587499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.862026] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a0af91f-7a9a-428e-8f4e-30a36c587499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.935370] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.180891] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.180982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.180982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.181257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.181302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.181492] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 is going to be created. [ 676.211207] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.211822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.211948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.212199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.212366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.218173] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.218626] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.218626] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.218848] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.218950] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.219067] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 4f1597b2-46bd-41d1-a992-d4a6ffd289bf not found, creating... [ 676.219300] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.219467] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.219573] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.219803] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.219960] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.220229] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.223276] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.223276] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.223276] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.223276] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.223276] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 4f1597b2-46bd-41d1-a992-d4a6ffd289bf is going to be created. [ 676.223276] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.226239] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: UNINITIALIZED for 2s [ 676.246014] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.246883] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.246883] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.246883] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.247122] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.247307] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-4f1597b2-46bd-41d1-a992-d4a6ffd289bf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.364769] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a0af91f-7a9a-428e-8f4e-30a36c587499 [ 676.365062] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.365520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.365659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.365771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.365946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.365993] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a0af91f-7a9a-428e-8f4e-30a36c587499 already deleted. [ 676.366043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a0af91f-7a9a-428e-8f4e-30a36c587499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.437512] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.437954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.437954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.438074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.438116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.438203] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be updated. [ 676.440090] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 676.440282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.473383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.473383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.473383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.473383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.473383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.483997] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 676.726836] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.727206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.727206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.727309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.727430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.727486] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 is going to be updated. [ 676.758564] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.758746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.758796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.759204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.759376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.771130] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: IN_PROGRESS for 2s [ 676.987779] env[66730]: INFO networking_nsxv3.common.synchronization [req-86652d60-26a2-4589-9782-3fa1dd45ee47 req-ca227517-c1a5-4ddc-a385-bdd1ebc67b35 service nova] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_rules [ 676.988089] env[66730]: INFO networking_nsxv3.common.synchronization [req-86652d60-26a2-4589-9782-3fa1dd45ee47 req-ca227517-c1a5-4ddc-a385-bdd1ebc67b35 service nova] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 676.988089] env[66730]: INFO networking_nsxv3.common.synchronization [req-86652d60-26a2-4589-9782-3fa1dd45ee47 req-ca227517-c1a5-4ddc-a385-bdd1ebc67b35 service nova] Enqueued Resource ID: 4f1597b2-46bd-41d1-a992-d4a6ffd289bf with Priority: HIGHEST for action port [ 676.988620] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_rules [ 676.988765] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 676.988862] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f1597b2-46bd-41d1-a992-d4a6ffd289bf with Priority: HIGHEST for action port [ 676.991217] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.991217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.991217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.991217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.991217] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.992037] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.992037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.992706] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f1597b2-46bd-41d1-a992-d4a6ffd289bf taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.992912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f1597b2-46bd-41d1-a992-d4a6ffd289bf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.992912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f1597b2-46bd-41d1-a992-d4a6ffd289bf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.993082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f1597b2-46bd-41d1-a992-d4a6ffd289bf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.993170] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f1597b2-46bd-41d1-a992-d4a6ffd289bf',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.262838] env[66730]: INFO networking_nsxv3.common.synchronization [req-bb232187-bc20-4dc6-994c-bfeb9d3586a3 req-17e3758b-db32-4a2b-b90c-cf3e642bf137 tempest-ListServerFiltersTestJSON-701955747 tempest-ListServerFiltersTestJSON-701955747-project-member] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 677.265065] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 677.265444] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.266051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.454425] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 in Status: SUCCESS [ 677.454717] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 deletion is rescheduled due to dependency. [ 677.454717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.495295] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.495441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.496846] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f1597b2-46bd-41d1-a992-d4a6ffd289bf with status ACTIVE [ 677.497479] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.497479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.497479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.497479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.497722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.497758] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.497864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.497914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.498077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.498153] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.498375] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.498448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.498448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.498605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.498675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.498758] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f1597b2-46bd-41d1-a992-d4a6ffd289bf is going to be updated. [ 677.521886] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.521886] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.521886] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.522398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.522398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.522398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f1597b2-46bd-41d1-a992-d4a6ffd289bf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.702961] env[66730]: INFO networking_nsxv3.common.synchronization [None req-920fd424-66ac-45a0-a562-f8e8423db3f1 None None] Enqueued Resource ID: 214871fe-7a70-48a4-b82c-bc6d77fb4437 with Priority: HIGHEST for action port [ 677.703254] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 214871fe-7a70-48a4-b82c-bc6d77fb4437 with Priority: HIGHEST for action port [ 677.703592] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-214871fe-7a70-48a4-b82c-bc6d77fb4437 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.703663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-214871fe-7a70-48a4-b82c-bc6d77fb4437" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.703715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-214871fe-7a70-48a4-b82c-bc6d77fb4437" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.703957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-214871fe-7a70-48a4-b82c-bc6d77fb4437" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.704055] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('214871fe-7a70-48a4-b82c-bc6d77fb4437',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.206423] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 214871fe-7a70-48a4-b82c-bc6d77fb4437 [ 678.207206] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.207206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.207206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.207206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.207206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.207458] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:214871fe-7a70-48a4-b82c-bc6d77fb4437 already deleted. [ 678.207458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-214871fe-7a70-48a4-b82c-bc6d77fb4437" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.239096] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: SUCCESS [ 678.239325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.239627] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.239718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.241017] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.241017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.241017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.241017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.241017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.241017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.241017] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.494973] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 678.495397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.495580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.495851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.496096] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.496251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.496425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.496609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.496704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.496802] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.516298] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.516298] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.516641] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.516641] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.518484] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.518707] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.518857] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.519156] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.519323] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.519581] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.519783] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.519916] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.520050] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.520194] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.520302] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.520462] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.543540] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.544310] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 678.544310] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.544310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-822" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.545207] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-d6b2ad7e-9a6e-4536-9daa-090773c59886 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.545207] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-d6b2ad7e-9a6e-4536-9daa-090773c59886" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.545207] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-d6b2ad7e-9a6e-4536-9daa-090773c59886" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.545207] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-d6b2ad7e-9a6e-4536-9daa-090773c59886" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.545603] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6b2ad7e-9a6e-4536-9daa-090773c59886',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.688842] env[66730]: INFO networking_nsxv3.common.synchronization [None req-b301476f-bb5c-4c0a-b937-f4ba196f69e8 None None] Enqueued Resource ID: 005174a7-dd69-45aa-a0bb-e27c558013de with Priority: HIGHEST for action port [ 678.690059] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005174a7-dd69-45aa-a0bb-e27c558013de with Priority: HIGHEST for action port [ 678.690462] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-005174a7-dd69-45aa-a0bb-e27c558013de taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.690620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-005174a7-dd69-45aa-a0bb-e27c558013de" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.690750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-005174a7-dd69-45aa-a0bb-e27c558013de" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.690998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-005174a7-dd69-45aa-a0bb-e27c558013de" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.691111] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('005174a7-dd69-45aa-a0bb-e27c558013de',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.742771] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.783731] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: SUCCESS [ 678.784045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.002437] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.047759] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.050543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.050543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.050543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.050543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.050543] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port d6b2ad7e-9a6e-4536-9daa-090773c59886 not found, creating... [ 679.050543] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.050543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.050543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.050543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.050543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.050979] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.050979] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.050979] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.051511] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.051807] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.052098] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: d6b2ad7e-9a6e-4536-9daa-090773c59886 is going to be created. [ 679.073625] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.074948] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.074948] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.075110] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.075604] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.075900] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-d6b2ad7e-9a6e-4536-9daa-090773c59886" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.196289] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 005174a7-dd69-45aa-a0bb-e27c558013de [ 679.196642] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.196843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.196955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.199360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.199360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.199360] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:005174a7-dd69-45aa-a0bb-e27c558013de already deleted. [ 679.199360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-005174a7-dd69-45aa-a0bb-e27c558013de" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.245252] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9: rpc.has_security_group_logging(os_id): False [ 679.268091] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.268091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.268091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.268507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.268507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.269421] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.269421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.269421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.269421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.269421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.269421] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 is going to be created. [ 679.368856] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.369085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.369134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.369697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.369697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.383777] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: IN_PROGRESS for 2s [ 679.505419] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.730127] env[66730]: INFO networking_nsxv3.common.synchronization [None req-970b6203-6ec2-4ef6-9b4d-a3b54b48c73b None None] Enqueued Resource ID: 4f891c28-dcfd-42fb-a32e-c33acf08e483 with Priority: HIGHEST for action port [ 679.730603] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f891c28-dcfd-42fb-a32e-c33acf08e483 with Priority: HIGHEST for action port [ 679.730888] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f891c28-dcfd-42fb-a32e-c33acf08e483 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.735113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f891c28-dcfd-42fb-a32e-c33acf08e483" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.735212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f891c28-dcfd-42fb-a32e-c33acf08e483" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.735621] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f891c28-dcfd-42fb-a32e-c33acf08e483" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.735621] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f891c28-dcfd-42fb-a32e-c33acf08e483',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.808294] env[66730]: INFO networking_nsxv3.common.synchronization [req-bb232187-bc20-4dc6-994c-bfeb9d3586a3 req-2493f0ab-dbe3-4735-8821-fea7a6e833e8 service nova] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_rules [ 679.808445] env[66730]: INFO networking_nsxv3.common.synchronization [req-bb232187-bc20-4dc6-994c-bfeb9d3586a3 req-2493f0ab-dbe3-4735-8821-fea7a6e833e8 service nova] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 679.808602] env[66730]: INFO networking_nsxv3.common.synchronization [req-bb232187-bc20-4dc6-994c-bfeb9d3586a3 req-2493f0ab-dbe3-4735-8821-fea7a6e833e8 service nova] Enqueued Resource ID: d6b2ad7e-9a6e-4536-9daa-090773c59886 with Priority: HIGHEST for action port [ 679.812561] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_rules [ 679.812561] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 679.812561] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b2ad7e-9a6e-4536-9daa-090773c59886 with Priority: HIGHEST for action port [ 679.812561] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.812561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.812561] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.812561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.812561] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6b2ad7e-9a6e-4536-9daa-090773c59886 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.812561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6b2ad7e-9a6e-4536-9daa-090773c59886" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.812561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6b2ad7e-9a6e-4536-9daa-090773c59886" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.812561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6b2ad7e-9a6e-4536-9daa-090773c59886" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.812561] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6b2ad7e-9a6e-4536-9daa-090773c59886',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.013405] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.013405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.013405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.013405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.013405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.013405] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be updated. [ 680.046214] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.046214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.046214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.046511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.046672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.058869] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 680.174159] env[66730]: INFO networking_nsxv3.common.synchronization [req-4335045e-d44a-4d31-9138-ee824d9ce0ff req-21a77747-c3cc-42f7-8c78-29c841b6de4e tempest-ServerAddressesTestJSON-730458700 tempest-ServerAddressesTestJSON-730458700-project-member] Enqueued Resource ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a with Priority: HIGHEST for action security_group_members [ 680.174969] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a with Priority: HIGHEST for action security_group_members [ 680.175364] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c5c58e-4b22-4273-bd10-70b2a85bf96a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.175511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.175511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.175765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.175947] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.176063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.176133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.176274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.177092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.177092] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34c5c58e-4b22-4273-bd10-70b2a85bf96a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.237853] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f891c28-dcfd-42fb-a32e-c33acf08e483 [ 680.239493] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.240418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.240418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.240418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.240418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.240418] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f891c28-dcfd-42fb-a32e-c33acf08e483 already deleted. [ 680.240418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f891c28-dcfd-42fb-a32e-c33acf08e483" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.315447] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6b2ad7e-9a6e-4536-9daa-090773c59886 with status ACTIVE [ 680.316402] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.316574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.316870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.317348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.317348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.317485] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.317599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.318571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.318571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.318571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.319332] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.319485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.319566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.319777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.319910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.319966] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6b2ad7e-9a6e-4536-9daa-090773c59886 is going to be updated. [ 680.352340] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.352479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.352547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.352759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.352890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.353069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6b2ad7e-9a6e-4536-9daa-090773c59886" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.680587] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.681135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.681135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.681441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.681650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.682064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.682064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.682204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.682417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.682556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.682688] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a already deleted. [ 680.682743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.764315] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.765644] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-759" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.765644] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-759" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.765644] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-759" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.765876] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.766047] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.766100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.766375] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.766513] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.766746] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.766853] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.766942] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.767048] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.767146] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.767259] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.767574] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.778973] env[66730]: INFO networking_nsxv3.common.synchronization [None req-ea980db2-0439-4cc7-afa3-b81d10323661 None None] Enqueued Resource ID: 58f90864-40db-416f-976b-2bbc52b82a9a with Priority: HIGHEST for action port [ 680.780284] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58f90864-40db-416f-976b-2bbc52b82a9a with Priority: HIGHEST for action port [ 680.781496] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-58f90864-40db-416f-976b-2bbc52b82a9a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.782913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58f90864-40db-416f-976b-2bbc52b82a9a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.782913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58f90864-40db-416f-976b-2bbc52b82a9a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.782913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58f90864-40db-416f-976b-2bbc52b82a9a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.782913] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58f90864-40db-416f-976b-2bbc52b82a9a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.791883] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.792941] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.792941] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.792941] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-759" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.792941] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-bccad37e-fbb0-480a-bbd2-a55f4af52efb taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.793226] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-bccad37e-fbb0-480a-bbd2-a55f4af52efb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.793226] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-bccad37e-fbb0-480a-bbd2-a55f4af52efb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.793464] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-bccad37e-fbb0-480a-bbd2-a55f4af52efb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.793714] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bccad37e-fbb0-480a-bbd2-a55f4af52efb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.285197] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58f90864-40db-416f-976b-2bbc52b82a9a [ 681.286294] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.286497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.286602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.286905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.287272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.287272] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58f90864-40db-416f-976b-2bbc52b82a9a already deleted. [ 681.287272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58f90864-40db-416f-976b-2bbc52b82a9a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.296799] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.297119] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.297296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.297718] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.297903] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.298123] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port bccad37e-fbb0-480a-bbd2-a55f4af52efb not found, creating... [ 681.298514] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.298741] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.298904] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.299263] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.299451] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.299878] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.300108] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.300272] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.301463] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.301463] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.301463] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: bccad37e-fbb0-480a-bbd2-a55f4af52efb is going to be created. [ 681.322836] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.322836] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.323302] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.323302] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.323612] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.323927] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-bccad37e-fbb0-480a-bbd2-a55f4af52efb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.396886] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: SUCCESS [ 681.397168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.016997] env[66730]: INFO networking_nsxv3.common.synchronization [req-4335045e-d44a-4d31-9138-ee824d9ce0ff req-618e076f-0934-44f7-afe0-cb921bf9fe8e service nova] Enqueued Resource ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a with Priority: HIGHEST for action security_group_rules [ 682.017590] env[66730]: INFO networking_nsxv3.common.synchronization [req-4335045e-d44a-4d31-9138-ee824d9ce0ff req-618e076f-0934-44f7-afe0-cb921bf9fe8e service nova] Enqueued Resource ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a with Priority: HIGHEST for action security_group_members [ 682.017755] env[66730]: INFO networking_nsxv3.common.synchronization [req-4335045e-d44a-4d31-9138-ee824d9ce0ff req-618e076f-0934-44f7-afe0-cb921bf9fe8e service nova] Enqueued Resource ID: bccad37e-fbb0-480a-bbd2-a55f4af52efb with Priority: HIGHEST for action port [ 682.019872] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a with Priority: HIGHEST for action security_group_rules [ 682.019872] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a with Priority: HIGHEST for action security_group_members [ 682.019872] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccad37e-fbb0-480a-bbd2-a55f4af52efb with Priority: HIGHEST for action port [ 682.019872] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34c5c58e-4b22-4273-bd10-70b2a85bf96a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.019872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.020199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.020595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.020748] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34c5c58e-4b22-4273-bd10-70b2a85bf96a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.023624] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c5c58e-4b22-4273-bd10-70b2a85bf96a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.024199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.024335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.024583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.024803] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.025148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.025148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.025535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.025980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.026175] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34c5c58e-4b22-4273-bd10-70b2a85bf96a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.027315] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-bccad37e-fbb0-480a-bbd2-a55f4af52efb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.027533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bccad37e-fbb0-480a-bbd2-a55f4af52efb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.027689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bccad37e-fbb0-480a-bbd2-a55f4af52efb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.028011] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bccad37e-fbb0-480a-bbd2-a55f4af52efb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.028201] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bccad37e-fbb0-480a-bbd2-a55f4af52efb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.069645] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 682.070109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.070994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.071312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.071796] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.072231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.072357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.072550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.072750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.072750] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.530249] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34c5c58e-4b22-4273-bd10-70b2a85bf96a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.533364] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c5c58e-4b22-4273-bd10-70b2a85bf96a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.533364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.533817] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bccad37e-fbb0-480a-bbd2-a55f4af52efb with status ACTIVE [ 682.534038] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.534207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.534247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.534454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.534537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.534738] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.534845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.534905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.536018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.536175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.536428] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.536580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.536684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.536900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.537611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.537611] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bccad37e-fbb0-480a-bbd2-a55f4af52efb is going to be updated. [ 682.567289] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.567438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.567550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.567983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.567983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.568254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bccad37e-fbb0-480a-bbd2-a55f4af52efb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.577262] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.035467] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34c5c58e-4b22-4273-bd10-70b2a85bf96a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.079645] env[66730]: INFO networking_nsxv3.common.synchronization [req-3736d6a5-619f-4516-9a29-9686c3273bd0 req-8ac3efb7-14f5-4e2e-9dc8-e95bfa344c98 tempest-ServersNegativeTestJSON-256798717 tempest-ServersNegativeTestJSON-256798717-project-member] Enqueued Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 683.079645] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 683.079645] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.079645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.079645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.080458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.081108] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.081108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.081108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.082991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.082991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.082991] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.082991] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.540519] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.540519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.540519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.540519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.540891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.540891] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a is going to be created. [ 683.575143] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.575143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.575143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.575143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.575143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.586292] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.586519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.586701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.586824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.586878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.587099] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.587321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.587321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.587438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.587485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.587573] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc already deleted. [ 683.587786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.588036] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.588232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.588232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.588426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.588426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.588579] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be updated. [ 683.590567] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a in Status: UNINITIALIZED for 2s [ 683.634922] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.635086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.635171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.635454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.635657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.645684] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 683.664054] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.664294] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.664402] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.664760] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.665031] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.665167] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.665287] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.665476] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.665672] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.665834] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.665939] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.666048] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.666146] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.666245] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.666342] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.666463] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.707436] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.707601] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.707860] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.708458] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.708997] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-2c9f0934-3b55-44dc-b6ed-1443527c9831 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.709213] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.709334] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.709703] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.709928] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c9f0934-3b55-44dc-b6ed-1443527c9831',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.214043] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.214043] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.214043] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.214566] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.214566] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.214566] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 2c9f0934-3b55-44dc-b6ed-1443527c9831 not found, creating... [ 684.214944] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.215021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.215285] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.215556] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.215766] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.216201] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.216379] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.216437] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.216642] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.216770] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.216902] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 2c9f0934-3b55-44dc-b6ed-1443527c9831 is going to be created. [ 684.241457] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.241679] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.241795] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.242077] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.242295] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.242504] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.961946] env[66730]: INFO networking_nsxv3.common.synchronization [req-3736d6a5-619f-4516-9a29-9686c3273bd0 req-06d8405c-2c11-4bf7-a053-41956056f365 service nova] Enqueued Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_rules [ 684.966261] env[66730]: INFO networking_nsxv3.common.synchronization [req-3736d6a5-619f-4516-9a29-9686c3273bd0 req-06d8405c-2c11-4bf7-a053-41956056f365 service nova] Enqueued Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 684.966495] env[66730]: INFO networking_nsxv3.common.synchronization [req-3736d6a5-619f-4516-9a29-9686c3273bd0 req-06d8405c-2c11-4bf7-a053-41956056f365 service nova] Enqueued Resource ID: 2c9f0934-3b55-44dc-b6ed-1443527c9831 with Priority: HIGHEST for action port [ 684.967064] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_rules [ 684.967697] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 684.967814] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c9f0934-3b55-44dc-b6ed-1443527c9831 with Priority: HIGHEST for action port [ 684.968128] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.968266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.968390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.968592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.968665] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.970078] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.970222] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.970282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.970702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.970702] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.970702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.971029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.971029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.971029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.971206] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.971924] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c9f0934-3b55-44dc-b6ed-1443527c9831 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.972051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.972357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.972357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.972357] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c9f0934-3b55-44dc-b6ed-1443527c9831',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.480673] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.480673] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.480673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.480673] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c9f0934-3b55-44dc-b6ed-1443527c9831 with status ACTIVE [ 685.480673] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.480673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.480673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.480673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.480673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.480673] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.480673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.480673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.483159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.484270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.486022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.486022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.486022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.486022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.486022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.486022] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c9f0934-3b55-44dc-b6ed-1443527c9831 is going to be updated. [ 685.513474] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.513474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.513474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.513474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.513474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.513474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.605024] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a in Status: SUCCESS [ 685.605024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.605024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.605024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.605024] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.605024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.605024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.605024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.605024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.605024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.605024] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34c5c58e-4b22-4273-bd10-70b2a85bf96a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.668027] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 685.668027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.668027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.668027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.668027] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.668027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.668027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.668027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.668027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.668027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.668027] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.669537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.669933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.670264] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.673997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.673997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.673997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.673997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.673997] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.897332] env[66730]: INFO networking_nsxv3.common.synchronization [None req-0e947f83-7314-4ea3-848b-4a1c562b9a85 None None] Enqueued Resource ID: 208fdae4-b568-45da-9c50-2b086dcb1c47 with Priority: HIGHEST for action port [ 685.897332] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 208fdae4-b568-45da-9c50-2b086dcb1c47 with Priority: HIGHEST for action port [ 685.897332] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-208fdae4-b568-45da-9c50-2b086dcb1c47 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.897878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-208fdae4-b568-45da-9c50-2b086dcb1c47" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.898123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-208fdae4-b568-45da-9c50-2b086dcb1c47" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.898513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-208fdae4-b568-45da-9c50-2b086dcb1c47" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.898761] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('208fdae4-b568-45da-9c50-2b086dcb1c47',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.988692] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.111589] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c5c58e-4b22-4273-bd10-70b2a85bf96a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.111589] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.111589] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c5c58e-4b22-4273-bd10-70b2a85bf96a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.111589] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.111589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.112466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.112466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.112466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.112466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.112466] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34c5c58e-4b22-4273-bd10-70b2a85bf96a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.176121] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.178301] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.178301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.401815] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 208fdae4-b568-45da-9c50-2b086dcb1c47 [ 686.401815] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.401815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.402098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.402598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.402772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.403015] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:208fdae4-b568-45da-9c50-2b086dcb1c47 already deleted. [ 686.403200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-208fdae4-b568-45da-9c50-2b086dcb1c47" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.468702] env[66730]: INFO networking_nsxv3.common.synchronization [req-0a3b5c3b-d097-43e5-a799-9a8f6e5c2872 req-e8a0c573-93af-4d23-a6ae-2382f6866ae2 tempest-ServerDiagnosticsTest-132125429 tempest-ServerDiagnosticsTest-132125429-project-member] Enqueued Resource ID: 3990207f-c264-4f81-b18d-55d8c1cd003e with Priority: HIGHEST for action security_group_members [ 686.470446] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990207f-c264-4f81-b18d-55d8c1cd003e with Priority: HIGHEST for action security_group_members [ 686.471508] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990207f-c264-4f81-b18d-55d8c1cd003e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.471508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.471508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.471508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.471798] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.471798] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.471798] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.471941] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.472043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.472135] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990207f-c264-4f81-b18d-55d8c1cd003e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.492494] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.492494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.492948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.492948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.492948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.492948] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc is going to be created. [ 686.521867] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.522072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.522140] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.522375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.522578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.532724] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: UNINITIALIZED for 2s [ 686.616479] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34c5c58e-4b22-4273-bd10-70b2a85bf96a: rpc.has_security_group_logging(os_id): False [ 686.634794] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.634958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.635069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.635236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.635331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.635531] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.635657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.635733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.635819] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.635887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.636075] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.636187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.636260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.636345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.636412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.636583] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.636678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.636727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.636930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.636930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.637037] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a is going to be created. [ 686.679458] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.787615] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.787832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.787884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.788123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.788303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.803235] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a in Status: IN_PROGRESS for 2s [ 686.868102] env[66730]: INFO networking_nsxv3.common.synchronization [req-1cb62966-24fe-4d6e-927f-18ea6882e1d4 req-671207d3-7ab6-4af5-8aef-1d394084cbc1 tempest-DeleteServersAdminTestJSON-311808247 tempest-DeleteServersAdminTestJSON-311808247-project-member] Enqueued Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 686.869204] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGHEST for action security_group_members [ 686.869617] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.870089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.870089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.870468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.873801] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.873801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.874228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.874490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.874579] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.874721] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.975197] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.976275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.976275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.976275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.976275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.979165] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.979165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.979165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.979165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.979165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.979165] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990207f-c264-4f81-b18d-55d8c1cd003e is going to be updated. [ 687.009299] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.009485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.009561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.009816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.009994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.021560] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990207f-c264-4f81-b18d-55d8c1cd003e in Status: IN_PROGRESS for 2s [ 687.177959] env[66730]: INFO networking_nsxv3.common.synchronization [req-9c810524-75ff-44dd-967e-a3e3efc44ebf req-c1dc88c1-f6a2-4681-bfcb-e2d8022ae5bf tempest-FloatingIPsAssociationNegativeTestJSON-1868148739 tempest-FloatingIPsAssociationNegativeTestJSON-1868148739-project-member] Enqueued Resource ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 with Priority: HIGHEST for action security_group_members [ 687.177959] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 with Priority: HIGHEST for action security_group_members [ 687.182137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.182137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.182137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.182137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.182137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.182137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.182137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.182137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.182137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.182137] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cb9f836-7c49-4a1b-a86b-eb440ff5bf25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.183132] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.183415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.183640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.183943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.184180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.184403] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be updated. [ 687.209209] env[66730]: INFO networking_nsxv3.common.synchronization [None req-51caf87b-ebc5-48c2-a1a5-9338ff6c2dd0 None None] Enqueued Resource ID: 7d57e8ae-a844-4789-9501-f471f5d8fdbd with Priority: HIGHEST for action port [ 687.209209] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d57e8ae-a844-4789-9501-f471f5d8fdbd with Priority: HIGHEST for action port [ 687.209209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d57e8ae-a844-4789-9501-f471f5d8fdbd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.209209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d57e8ae-a844-4789-9501-f471f5d8fdbd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.209209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d57e8ae-a844-4789-9501-f471f5d8fdbd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.209209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d57e8ae-a844-4789-9501-f471f5d8fdbd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.209626] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d57e8ae-a844-4789-9501-f471f5d8fdbd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.218022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.218022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.218022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.218022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.218022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.229308] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 687.381039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.381365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.381365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.381452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.381531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.381792] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.382330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.382330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.382330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.382330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.382330] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 is going to be updated. [ 687.424433] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.424572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.424641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.424855] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.424990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.435895] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: IN_PROGRESS for 2s [ 687.683426] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.683426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.683426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.683426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.683426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.683426] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.683426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.687653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.687653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.687653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.687653] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 is going to be updated. [ 687.712562] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d57e8ae-a844-4789-9501-f471f5d8fdbd [ 687.712798] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.712931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.712993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.713359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.713447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.713608] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d57e8ae-a844-4789-9501-f471f5d8fdbd already deleted. [ 687.713688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d57e8ae-a844-4789-9501-f471f5d8fdbd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.716347] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.716504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.716611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.716748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.716876] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.727593] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 in Status: IN_PROGRESS for 2s [ 688.549043] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: SUCCESS [ 688.549043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.549043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.549043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.549043] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.549043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.549043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.549043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.549043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.549043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.549043] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.754290] env[66730]: INFO networking_nsxv3.common.synchronization [None req-19dcc0b6-f4b0-40e7-8b89-872fc7b6ca74 None None] Enqueued Resource ID: 1c2fa51e-8054-42c7-8a9e-09114fc15dc3 with Priority: HIGHEST for action port [ 688.754290] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2fa51e-8054-42c7-8a9e-09114fc15dc3 with Priority: HIGHEST for action port [ 688.755235] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c2fa51e-8054-42c7-8a9e-09114fc15dc3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.755235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c2fa51e-8054-42c7-8a9e-09114fc15dc3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.755235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c2fa51e-8054-42c7-8a9e-09114fc15dc3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.755454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c2fa51e-8054-42c7-8a9e-09114fc15dc3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.755454] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c2fa51e-8054-42c7-8a9e-09114fc15dc3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.819337] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a in Status: SUCCESS [ 688.819549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.033499] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990207f-c264-4f81-b18d-55d8c1cd003e in Status: SUCCESS [ 689.037343] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990207f-c264-4f81-b18d-55d8c1cd003e deletion is rescheduled due to dependency. [ 689.037483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990207f-c264-4f81-b18d-55d8c1cd003e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.053277] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.053803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.054056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.054155] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.054338] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.054447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.054512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.054889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.054989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.055114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.055312] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.055430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.055493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.055649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.056038] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.056142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.056205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.056623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.056623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.056623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.056728] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.241397] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 689.241698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.242160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.242360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.242608] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.242797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.242854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.243048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.243167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.243284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.243501] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.243646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.243775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.243911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.244098] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.244287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.244287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.244574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.244574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.244742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.244784] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.262685] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c2fa51e-8054-42c7-8a9e-09114fc15dc3 [ 689.263386] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.264471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.264471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.264471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.264471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.264471] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c2fa51e-8054-42c7-8a9e-09114fc15dc3 already deleted. [ 689.264471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c2fa51e-8054-42c7-8a9e-09114fc15dc3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.448936] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 in Status: SUCCESS [ 689.449098] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 deletion is rescheduled due to dependency. [ 689.450836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.559063] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc: rpc.has_security_group_logging(os_id): False [ 689.579308] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.579570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.579570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.579779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.579830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.580302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.580302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.580302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.580528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.580528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.580634] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.580711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.580758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.580880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.580955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.581147] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.581254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.581298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.581421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.581486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.581567] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc is going to be created. [ 689.630027] env[66730]: INFO networking_nsxv3.common.synchronization [req-7bf50b5b-7f4e-4f21-93d9-94ae4751d670 req-69f3b360-113e-446d-bc7a-0c7fae475adc tempest-SecurityGroupRulesTestJSON-2033598309 tempest-SecurityGroupRulesTestJSON-2033598309-project-member] Enqueued Resource ID: bbded26a-dd77-4c6a-a8c7-0da0795d8d40 with Priority: HIGHEST for action security_group_rules [ 689.630739] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbded26a-dd77-4c6a-a8c7-0da0795d8d40 with Priority: HIGHEST for action security_group_rules [ 689.631067] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbded26a-dd77-4c6a-a8c7-0da0795d8d40 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.631187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbded26a-dd77-4c6a-a8c7-0da0795d8d40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.631279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbded26a-dd77-4c6a-a8c7-0da0795d8d40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.631594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbded26a-dd77-4c6a-a8c7-0da0795d8d40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.631639] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbded26a-dd77-4c6a-a8c7-0da0795d8d40',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.644240] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.644240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.644240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.644240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.644240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.659913] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: IN_PROGRESS for 2s [ 689.746179] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 in Status: SUCCESS [ 689.746449] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 deletion is rescheduled due to dependency. [ 689.746519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.746735] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a03f84a-bddc-4833-9f99-c1dc77481962: rpc.has_security_group_logging(os_id): False [ 689.766661] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.766959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.766959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.767178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.767241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.767462] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.767564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.767628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.767832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.767913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.768391] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.768391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.768391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.768522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.768522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.770595] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.770595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.770595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.770595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.770595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.770595] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be updated. [ 689.863306] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.863452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.863559] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.863720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.863864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.879489] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 689.951107] env[66730]: INFO networking_nsxv3.common.synchronization [None req-fbb94634-e7e4-458b-a83f-74441baacf92 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_rules [ 689.951644] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_rules [ 689.951907] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d40e47e-8889-4be5-a560-287881831b93 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.952228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.952322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.952590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.952671] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d40e47e-8889-4be5-a560-287881831b93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.080715] env[66730]: INFO networking_nsxv3.common.synchronization [None req-c8c24213-b4c3-4915-ba48-98cabf45f03a tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_rules [ 690.082182] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_rules [ 690.082873] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d40e47e-8889-4be5-a560-287881831b93 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.082873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.156133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.156279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.159456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.159789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.159893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.160063] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbded26a-dd77-4c6a-a8c7-0da0795d8d40 already deleted. [ 690.160110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbded26a-dd77-4c6a-a8c7-0da0795d8d40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.475758] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.476764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.477131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.477712] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.478319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.478595] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d40e47e-8889-4be5-a560-287881831b93 already deleted. [ 690.478825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.479260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.479872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.480148] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d40e47e-8889-4be5-a560-287881831b93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.013352] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.013690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.013690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.013829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.013939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.014048] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d40e47e-8889-4be5-a560-287881831b93 already deleted. [ 691.014137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.673350] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: SUCCESS [ 691.673611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.757315] env[66730]: INFO networking_nsxv3.common.synchronization [None req-2abe57e7-fb90-46ad-bf7a-b0fb4ebef783 None None] Enqueued Resource ID: 3d0a033d-cfb8-4b17-a86a-c0c7ad1381fc with Priority: HIGHEST for action port [ 691.757704] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d0a033d-cfb8-4b17-a86a-c0c7ad1381fc with Priority: HIGHEST for action port [ 691.760337] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d0a033d-cfb8-4b17-a86a-c0c7ad1381fc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.760337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d0a033d-cfb8-4b17-a86a-c0c7ad1381fc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.760337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d0a033d-cfb8-4b17-a86a-c0c7ad1381fc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.760337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d0a033d-cfb8-4b17-a86a-c0c7ad1381fc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.760337] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d0a033d-cfb8-4b17-a86a-c0c7ad1381fc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.899870] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 691.899870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.899870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.899870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.899870] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.261120] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d0a033d-cfb8-4b17-a86a-c0c7ad1381fc [ 692.261538] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.265458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.265458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.265458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.265458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.265458] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d0a033d-cfb8-4b17-a86a-c0c7ad1381fc already deleted. [ 692.265458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d0a033d-cfb8-4b17-a86a-c0c7ad1381fc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.406061] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.406061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.406061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.406454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.408997] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.408997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.408997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.409193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.410244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.410244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.410244] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.441657] env[66730]: INFO networking_nsxv3.common.synchronization [None req-ff5f5c98-8d36-4225-96d8-1e04ba2ee8a4 tempest-ImagesOneServerNegativeTestJSON-160835856 tempest-ImagesOneServerNegativeTestJSON-160835856-project-member] Enqueued Resource ID: d87d83bc-3851-40f3-ac27-b6c2a0cf9a99 with Priority: HIGHEST for action security_group_rules [ 692.441657] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87d83bc-3851-40f3-ac27-b6c2a0cf9a99 with Priority: HIGHEST for action security_group_rules [ 692.441730] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87d83bc-3851-40f3-ac27-b6c2a0cf9a99 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.441853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87d83bc-3851-40f3-ac27-b6c2a0cf9a99" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.441919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87d83bc-3851-40f3-ac27-b6c2a0cf9a99" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.442199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87d83bc-3851-40f3-ac27-b6c2a0cf9a99" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.442422] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87d83bc-3851-40f3-ac27-b6c2a0cf9a99',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.731251] env[66730]: INFO networking_nsxv3.common.synchronization [None req-2a692bc5-ca38-4e00-876a-8e0dd12b289c tempest-ImagesOneServerNegativeTestJSON-160835856 tempest-ImagesOneServerNegativeTestJSON-160835856-project-member] Enqueued Resource ID: d87d83bc-3851-40f3-ac27-b6c2a0cf9a99 with Priority: HIGHEST for action security_group_rules [ 692.731299] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87d83bc-3851-40f3-ac27-b6c2a0cf9a99 with Priority: HIGHEST for action security_group_rules [ 692.732068] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87d83bc-3851-40f3-ac27-b6c2a0cf9a99 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.732068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87d83bc-3851-40f3-ac27-b6c2a0cf9a99" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.912887] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.913108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.913182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.913668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.913668] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.913803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.913803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.913974] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.914079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.914197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.914394] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.914518] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.914598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.914778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.914978] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.915125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.915180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.915357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.915438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.915536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.915641] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.971220] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.971399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.971477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.971773] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.971831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.971951] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87d83bc-3851-40f3-ac27-b6c2a0cf9a99 already deleted. [ 692.972086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87d83bc-3851-40f3-ac27-b6c2a0cf9a99" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.972269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87d83bc-3851-40f3-ac27-b6c2a0cf9a99" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.972434] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87d83bc-3851-40f3-ac27-b6c2a0cf9a99" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.972519] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87d83bc-3851-40f3-ac27-b6c2a0cf9a99',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.418237] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a03f84a-bddc-4833-9f99-c1dc77481962: rpc.has_security_group_logging(os_id): False [ 693.439383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.439554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.440397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.440397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.440397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.440560] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.440658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.440764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.440998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.441252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.441574] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.441833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.441992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.442307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.442455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.442694] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.442902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.442974] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.443340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.443340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.443558] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be updated. [ 693.502495] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.502768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.502887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.503291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.503436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.503584] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87d83bc-3851-40f3-ac27-b6c2a0cf9a99 already deleted. [ 693.503743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87d83bc-3851-40f3-ac27-b6c2a0cf9a99" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.533122] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.533364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.533364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.533659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.533858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.562602] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 695.004576] env[66730]: INFO networking_nsxv3.common.synchronization [None req-b97e02b8-2d0e-4bf1-b256-e1056683c556 tempest-MigrationsAdminTest-1802784989 tempest-MigrationsAdminTest-1802784989-project-member] Enqueued Resource ID: e333a129-f05e-40a4-b36a-d58e1eccda7b with Priority: HIGHEST for action security_group_rules [ 695.005287] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e333a129-f05e-40a4-b36a-d58e1eccda7b with Priority: HIGHEST for action security_group_rules [ 695.005675] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e333a129-f05e-40a4-b36a-d58e1eccda7b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.005831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e333a129-f05e-40a4-b36a-d58e1eccda7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.005908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e333a129-f05e-40a4-b36a-d58e1eccda7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.006184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e333a129-f05e-40a4-b36a-d58e1eccda7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.006269] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e333a129-f05e-40a4-b36a-d58e1eccda7b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.254724] env[66730]: INFO networking_nsxv3.common.synchronization [req-4df98274-4b2c-43af-99dc-d37f99d82dc7 req-ac7b20e0-109d-4921-9011-96dd0ef65bbf tempest-InstanceActionsNegativeTestJSON-2074973011 tempest-InstanceActionsNegativeTestJSON-2074973011-project-member] Enqueued Resource ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 with Priority: HIGHEST for action security_group_members [ 695.255574] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 with Priority: HIGHEST for action security_group_members [ 695.256098] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca41c1b-622d-4ab6-868b-84dca5e38456 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.256235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.256383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.256683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.256683] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.256841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.256841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.256965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.257063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.257161] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ca41c1b-622d-4ab6-868b-84dca5e38456',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.364547] env[66730]: INFO networking_nsxv3.common.synchronization [None req-013d231a-986d-4ca1-9fea-059a7f9d3179 tempest-MigrationsAdminTest-1802784989 tempest-MigrationsAdminTest-1802784989-project-member] Enqueued Resource ID: e333a129-f05e-40a4-b36a-d58e1eccda7b with Priority: HIGHEST for action security_group_rules [ 695.365809] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e333a129-f05e-40a4-b36a-d58e1eccda7b with Priority: HIGHEST for action security_group_rules [ 695.365809] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e333a129-f05e-40a4-b36a-d58e1eccda7b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.365809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e333a129-f05e-40a4-b36a-d58e1eccda7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.531769] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.531769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.532021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.532094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.532340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.532428] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e333a129-f05e-40a4-b36a-d58e1eccda7b already deleted. [ 695.532524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e333a129-f05e-40a4-b36a-d58e1eccda7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.533080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e333a129-f05e-40a4-b36a-d58e1eccda7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.533080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e333a129-f05e-40a4-b36a-d58e1eccda7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.533080] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e333a129-f05e-40a4-b36a-d58e1eccda7b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.579142] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 695.579142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.759298] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.759473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.759535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.761038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.761142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.761374] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.761489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.761553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.761729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.761812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.761909] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 is going to be updated. [ 695.822276] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.822492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.822492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.822684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.822823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.832892] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 in Status: IN_PROGRESS for 2s [ 696.058232] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.058576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.058576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.058672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.058907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.058907] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e333a129-f05e-40a4-b36a-d58e1eccda7b already deleted. [ 696.059364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e333a129-f05e-40a4-b36a-d58e1eccda7b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.234023] env[66730]: INFO networking_nsxv3.common.synchronization [req-cf9c6db9-35e3-4eb2-9d4c-3bf6009f5755 req-674fce89-d8af-4164-9ddd-f585b746e37b tempest-SecurityGroupRulesTestJSON-2033598309 tempest-SecurityGroupRulesTestJSON-2033598309-project-member] Enqueued Resource ID: d7094dbb-9fb5-4c46-a426-ba043fe83dfb with Priority: HIGHEST for action security_group_rules [ 696.234187] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7094dbb-9fb5-4c46-a426-ba043fe83dfb with Priority: HIGHEST for action security_group_rules [ 696.237494] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7094dbb-9fb5-4c46-a426-ba043fe83dfb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.237692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7094dbb-9fb5-4c46-a426-ba043fe83dfb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.238205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7094dbb-9fb5-4c46-a426-ba043fe83dfb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.238205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7094dbb-9fb5-4c46-a426-ba043fe83dfb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.238330] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7094dbb-9fb5-4c46-a426-ba043fe83dfb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.489081] env[66730]: INFO networking_nsxv3.common.synchronization [req-5fdc4a09-817a-4ed9-980e-478248db6cbd req-289b5ac0-73e9-4268-9acf-11c89edc5735 tempest-ServerAddressesNegativeTestJSON-492899833 tempest-ServerAddressesNegativeTestJSON-492899833-project-member] Enqueued Resource ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b with Priority: HIGHEST for action security_group_members [ 696.489081] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b with Priority: HIGHEST for action security_group_members [ 696.490167] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.490167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.490272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.490656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.490874] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.491043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.491247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.491326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.491433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.491599] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.765441] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.765441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.765441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.765441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.765441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.765441] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7094dbb-9fb5-4c46-a426-ba043fe83dfb already deleted. [ 696.765441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7094dbb-9fb5-4c46-a426-ba043fe83dfb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.849583] env[66730]: INFO networking_nsxv3.common.synchronization [None req-732ad0c4-6bf2-49e9-9a17-bc1687bee959 None None] Enqueued Resource ID: 20898e10-396d-4c9a-aa9f-63db69da487e with Priority: HIGHEST for action port [ 696.850338] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20898e10-396d-4c9a-aa9f-63db69da487e with Priority: HIGHEST for action port [ 696.850753] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-20898e10-396d-4c9a-aa9f-63db69da487e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.851011] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20898e10-396d-4c9a-aa9f-63db69da487e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.851011] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20898e10-396d-4c9a-aa9f-63db69da487e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.851270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20898e10-396d-4c9a-aa9f-63db69da487e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.851393] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20898e10-396d-4c9a-aa9f-63db69da487e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.001221] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.001364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.001456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.001684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.001997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.001997] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.002129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.002158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.002291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.002378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.002524] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b is going to be updated. [ 697.036126] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.036279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.036347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.036562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.038046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.048294] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b in Status: IN_PROGRESS for 2s [ 697.397065] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20898e10-396d-4c9a-aa9f-63db69da487e [ 697.397065] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.397536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.397536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.397536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.397687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.397716] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20898e10-396d-4c9a-aa9f-63db69da487e already deleted. [ 697.397908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20898e10-396d-4c9a-aa9f-63db69da487e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.844175] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 in Status: SUCCESS [ 697.844374] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 deletion is rescheduled due to dependency. [ 697.844487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.061425] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b in Status: SUCCESS [ 699.061830] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b deletion is rescheduled due to dependency. [ 699.061830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.318819] env[66730]: INFO networking_nsxv3.common.synchronization [req-f65be633-e82c-4216-8e0c-e0f9e957e0e2 req-b706f567-73cf-43b8-95d9-ae1b62278741 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_members [ 699.319415] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_members [ 699.319717] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.319843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.319913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.320197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.320356] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.320493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.320532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.320658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.320742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.320832] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.457938] env[66730]: INFO networking_nsxv3.common.synchronization [None req-d968ba69-ba22-4e48-be2a-d090f31ffed6 None None] Enqueued Resource ID: c1e3395f-5ee3-447c-a92a-aa23fd7ae76d with Priority: HIGHEST for action port [ 699.458599] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e3395f-5ee3-447c-a92a-aa23fd7ae76d with Priority: HIGHEST for action port [ 699.459033] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1e3395f-5ee3-447c-a92a-aa23fd7ae76d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.459464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1e3395f-5ee3-447c-a92a-aa23fd7ae76d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.459464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1e3395f-5ee3-447c-a92a-aa23fd7ae76d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.459721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1e3395f-5ee3-447c-a92a-aa23fd7ae76d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.459857] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1e3395f-5ee3-447c-a92a-aa23fd7ae76d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.721016] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.721259] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.721394] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.721766] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.722072] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.722238] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.722367] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.722605] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.722760] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.722988] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.723129] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.723304] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.723484] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.723484] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.723594] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.723725] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.744777] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.744777] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 699.746810] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.747089] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.747421] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-ede6fe0c-d952-4a37-8562-fa0e3a16e1c9 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.747590] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-ede6fe0c-d952-4a37-8562-fa0e3a16e1c9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.749019] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-ede6fe0c-d952-4a37-8562-fa0e3a16e1c9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.749019] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-ede6fe0c-d952-4a37-8562-fa0e3a16e1c9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.749019] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ede6fe0c-d952-4a37-8562-fa0e3a16e1c9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.824784] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.824986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.825099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.825369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.825522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.825889] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.825889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.826044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.826158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.826243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.826353] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 already deleted. [ 699.826441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.964604] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1e3395f-5ee3-447c-a92a-aa23fd7ae76d [ 699.964604] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.964604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.964604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.964604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.964604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.964604] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1e3395f-5ee3-447c-a92a-aa23fd7ae76d already deleted. [ 699.964604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1e3395f-5ee3-447c-a92a-aa23fd7ae76d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.256711] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.260026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.260026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.260026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.260026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.260026] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port ede6fe0c-d952-4a37-8562-fa0e3a16e1c9 not found, creating... [ 700.260026] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.260026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.260026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.260026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.260026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.260555] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.260555] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.260555] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.260964] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.261237] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.261635] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: ede6fe0c-d952-4a37-8562-fa0e3a16e1c9 is going to be created. [ 700.287704] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.287704] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.287704] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.287704] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.287704] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.287704] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-ede6fe0c-d952-4a37-8562-fa0e3a16e1c9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.994435] env[66730]: INFO networking_nsxv3.common.synchronization [req-f65be633-e82c-4216-8e0c-e0f9e957e0e2 req-684e2cae-d937-4347-bf2b-b9251cdcd1a3 service nova] Enqueued Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_rules [ 700.995073] env[66730]: INFO networking_nsxv3.common.synchronization [req-f65be633-e82c-4216-8e0c-e0f9e957e0e2 req-684e2cae-d937-4347-bf2b-b9251cdcd1a3 service nova] Enqueued Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_members [ 700.995073] env[66730]: INFO networking_nsxv3.common.synchronization [req-f65be633-e82c-4216-8e0c-e0f9e957e0e2 req-684e2cae-d937-4347-bf2b-b9251cdcd1a3 service nova] Enqueued Resource ID: ede6fe0c-d952-4a37-8562-fa0e3a16e1c9 with Priority: HIGHEST for action port [ 700.996259] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_rules [ 700.996390] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_members [ 700.996734] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ede6fe0c-d952-4a37-8562-fa0e3a16e1c9 with Priority: HIGHEST for action port [ 700.996846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.996911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.000211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.000597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.000597] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.001675] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.002036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.002036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.002326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.002612] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.002756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.002876] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.003140] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.003281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.003611] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.007113] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-ede6fe0c-d952-4a37-8562-fa0e3a16e1c9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.007337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ede6fe0c-d952-4a37-8562-fa0e3a16e1c9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.007450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ede6fe0c-d952-4a37-8562-fa0e3a16e1c9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.007878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ede6fe0c-d952-4a37-8562-fa0e3a16e1c9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.007940] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ede6fe0c-d952-4a37-8562-fa0e3a16e1c9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.338364] env[66730]: INFO networking_nsxv3.common.synchronization [None req-8d6f4e89-7038-4979-bdc1-20a8a490382d None None] Enqueued Resource ID: e15c7c71-707f-4a9b-91f5-8efabaf55c5a with Priority: HIGHEST for action port [ 701.338364] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e15c7c71-707f-4a9b-91f5-8efabaf55c5a with Priority: HIGHEST for action port [ 701.338364] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e15c7c71-707f-4a9b-91f5-8efabaf55c5a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.338364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e15c7c71-707f-4a9b-91f5-8efabaf55c5a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.338364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e15c7c71-707f-4a9b-91f5-8efabaf55c5a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.338364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e15c7c71-707f-4a9b-91f5-8efabaf55c5a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.338364] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e15c7c71-707f-4a9b-91f5-8efabaf55c5a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.507570] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.511051] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.511051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.511051] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ede6fe0c-d952-4a37-8562-fa0e3a16e1c9 with status ACTIVE [ 701.511253] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.511396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.511578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.511786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.511914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.513271] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.513271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.513271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.513271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.513271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.513271] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.513271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.513271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.513765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.513765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.513989] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ede6fe0c-d952-4a37-8562-fa0e3a16e1c9 is going to be updated. [ 701.538463] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.538684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.538838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.539236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.539236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.539546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ede6fe0c-d952-4a37-8562-fa0e3a16e1c9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.841438] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e15c7c71-707f-4a9b-91f5-8efabaf55c5a [ 701.841438] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.841438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.841438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.841438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.841438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.841438] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e15c7c71-707f-4a9b-91f5-8efabaf55c5a already deleted. [ 701.841808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e15c7c71-707f-4a9b-91f5-8efabaf55c5a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.886171] env[66730]: INFO networking_nsxv3.common.synchronization [req-5fcc54fc-9725-409a-8a4c-a8fd9db0a84a req-ffc03028-f83c-426e-8776-3515d8754f6b tempest-ServersAdminTestJSON-1056025790 tempest-ServersAdminTestJSON-1056025790-project-member] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 701.886416] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 701.886830] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.887099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.887256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.887573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.887846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.888522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.888703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.888991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.889187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.889370] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.013647] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.392213] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.392521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.392521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.396205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.396205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.396205] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.396205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.396205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.396205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.396205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.396205] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 already deleted. [ 702.396205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.515856] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.516060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.516101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.516311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.516392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.516487] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 is going to be created. [ 702.544639] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.544639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.544858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.544981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.545436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.556858] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 in Status: UNINITIALIZED for 2s [ 702.590531] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.590829] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.590958] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.591636] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.592906] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.592906] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.592906] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.593266] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.593522] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.593784] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.593911] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.594106] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.594280] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.594638] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.594692] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.594870] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.625245] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.626575] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 702.626575] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.626575] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.626575] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-08471c24-f26e-47f4-a6d7-0a5ee1d38e5e taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.626575] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-08471c24-f26e-47f4-a6d7-0a5ee1d38e5e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.626575] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-08471c24-f26e-47f4-a6d7-0a5ee1d38e5e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.626809] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-08471c24-f26e-47f4-a6d7-0a5ee1d38e5e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.626890] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08471c24-f26e-47f4-a6d7-0a5ee1d38e5e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.129588] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.130074] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.130454] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.132546] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.132546] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.132546] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 08471c24-f26e-47f4-a6d7-0a5ee1d38e5e not found, creating... [ 703.132546] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.132546] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.133723] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.134037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.134181] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.134537] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.135429] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.135429] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.135429] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.135429] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.135429] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 08471c24-f26e-47f4-a6d7-0a5ee1d38e5e is going to be created. [ 703.160681] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.160884] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.161008] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.161637] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.161889] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.162310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-08471c24-f26e-47f4-a6d7-0a5ee1d38e5e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.872037] env[66730]: INFO networking_nsxv3.common.synchronization [req-5fcc54fc-9725-409a-8a4c-a8fd9db0a84a req-098ac652-b23f-4b9f-ad92-b7390d82f585 service nova] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_rules [ 703.872375] env[66730]: INFO networking_nsxv3.common.synchronization [req-5fcc54fc-9725-409a-8a4c-a8fd9db0a84a req-098ac652-b23f-4b9f-ad92-b7390d82f585 service nova] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 703.872492] env[66730]: INFO networking_nsxv3.common.synchronization [req-5fcc54fc-9725-409a-8a4c-a8fd9db0a84a req-098ac652-b23f-4b9f-ad92-b7390d82f585 service nova] Enqueued Resource ID: 08471c24-f26e-47f4-a6d7-0a5ee1d38e5e with Priority: HIGHEST for action port [ 703.873547] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_rules [ 703.873822] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 703.875540] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08471c24-f26e-47f4-a6d7-0a5ee1d38e5e with Priority: HIGHEST for action port [ 703.875540] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.875540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.875540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.875540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.875540] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.877659] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.879957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.879957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.882218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.882218] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.882218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.882218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.882218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.882218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.882218] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.882906] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-08471c24-f26e-47f4-a6d7-0a5ee1d38e5e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.885211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08471c24-f26e-47f4-a6d7-0a5ee1d38e5e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.886028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08471c24-f26e-47f4-a6d7-0a5ee1d38e5e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.887043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08471c24-f26e-47f4-a6d7-0a5ee1d38e5e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.887128] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08471c24-f26e-47f4-a6d7-0a5ee1d38e5e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.283022] env[66730]: INFO networking_nsxv3.common.synchronization [None req-74cc6f28-f732-4d93-83e8-9b4af82c24cd tempest-ServerActionsTestOtherB-1094684457 tempest-ServerActionsTestOtherB-1094684457-project-member] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 704.283022] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 704.283022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.283022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.283022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.283022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.283022] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.389405] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.391674] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.391674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.391674] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08471c24-f26e-47f4-a6d7-0a5ee1d38e5e with status ACTIVE [ 704.391674] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.394563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.394563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.394848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.394848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.395023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.395135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.395199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.395351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.395430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.395620] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.395715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.395770] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.395905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.395979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.396126] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08471c24-f26e-47f4-a6d7-0a5ee1d38e5e is going to be updated. [ 704.422190] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.422332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.422405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.422618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.422751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.422910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08471c24-f26e-47f4-a6d7-0a5ee1d38e5e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.570028] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 in Status: SUCCESS [ 704.570028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.570028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.570232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.570914] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.570914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.570914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.570914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.570914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.571692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.571871] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.654463] env[66730]: INFO networking_nsxv3.common.synchronization [req-050e36b4-0078-4d93-b97f-f32d958cf058 req-d5fcf068-a97d-40f4-9c4b-f03d1535a782 tempest-ServersAdminTestJSON-1056025790 tempest-ServersAdminTestJSON-1056025790-project-member] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 704.658133] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 704.658133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.658133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.685601] env[66730]: INFO networking_nsxv3.common.synchronization [None req-aeb10317-ca64-4423-8f23-9dcffe3e126f tempest-ServerActionsTestOtherB-1094684457 tempest-ServerActionsTestOtherB-1094684457-project-member] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 704.685850] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 704.687064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.687159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.808302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.808302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.808302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.808302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.808302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.808302] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba already deleted. [ 704.808302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.808302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.808302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.808302] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.899474] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.075570] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.252264] env[66730]: INFO networking_nsxv3.common.synchronization [None req-43282673-59d5-4479-be84-1dddfa10f815 None None] Enqueued Resource ID: 12a12602-91a3-411d-a1e7-7bd787899d2f with Priority: HIGHEST for action port [ 705.252264] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a12602-91a3-411d-a1e7-7bd787899d2f with Priority: HIGHEST for action port [ 705.252264] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-12a12602-91a3-411d-a1e7-7bd787899d2f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.252264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12a12602-91a3-411d-a1e7-7bd787899d2f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.252264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12a12602-91a3-411d-a1e7-7bd787899d2f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.252264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12a12602-91a3-411d-a1e7-7bd787899d2f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.252264] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a12602-91a3-411d-a1e7-7bd787899d2f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.284021] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.284021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.284021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.284021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.288296] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.288296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.288296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.288296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.288296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.288296] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.288296] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.288296] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.288296] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.288296] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.288296] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.288296] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.309312] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.309459] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.309591] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.309764] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.310094] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.310262] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.311371] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.311371] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.311371] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.331082] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.331396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.331565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.331853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.332089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.332212] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba already deleted. [ 705.332306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.401791] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.401791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.402083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.402167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.402512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.402512] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be created. [ 705.428203] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.428495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.428495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.428611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.428768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.440484] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: UNINITIALIZED for 2s [ 705.581402] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0: rpc.has_security_group_logging(os_id): False [ 705.602012] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.602253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.602392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.602678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.602950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.603202] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.603319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.603388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.603613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.603793] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.603891] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 is going to be created. [ 705.674547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.674690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.674759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.674973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.675177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.678782] env[66730]: INFO networking_nsxv3.common.synchronization [None req-543dcf6c-d876-41b0-8d93-4c3063e934cb tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_rules [ 705.678977] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_rules [ 705.679527] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.679639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.679705] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.679939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.680086] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.687710] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 in Status: IN_PROGRESS for 2s [ 705.754250] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12a12602-91a3-411d-a1e7-7bd787899d2f [ 705.754499] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.754637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.754744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.755114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.755114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.755263] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12a12602-91a3-411d-a1e7-7bd787899d2f already deleted. [ 705.755299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12a12602-91a3-411d-a1e7-7bd787899d2f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.814758] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.814989] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.815124] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.815395] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.815535] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.815683] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e not found, creating... [ 705.815979] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.816150] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.816261] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.816471] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.816600] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.816875] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.817227] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.817364] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.817588] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.817724] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.817885] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e is going to be created. [ 705.843951] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.844297] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.844509] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.844926] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.845302] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.845634] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.013131] env[66730]: INFO networking_nsxv3.common.synchronization [None req-5aa2c830-6c36-4aea-9ff2-ecd5ea5a99fc tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_rules [ 706.013131] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_rules [ 706.013449] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.013532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.201302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.201574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.201574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.201714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.201803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.201895] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 already deleted. [ 706.201980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.202138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.202286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.202369] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.576576] env[66730]: INFO networking_nsxv3.common.synchronization [req-050e36b4-0078-4d93-b97f-f32d958cf058 req-7dce9a43-6892-4aae-b49f-5513374db198 service nova] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_rules [ 706.576692] env[66730]: INFO networking_nsxv3.common.synchronization [req-050e36b4-0078-4d93-b97f-f32d958cf058 req-7dce9a43-6892-4aae-b49f-5513374db198 service nova] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 706.576814] env[66730]: INFO networking_nsxv3.common.synchronization [req-050e36b4-0078-4d93-b97f-f32d958cf058 req-7dce9a43-6892-4aae-b49f-5513374db198 service nova] Enqueued Resource ID: b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e with Priority: HIGHEST for action port [ 706.577410] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_rules [ 706.577553] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 706.577647] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e with Priority: HIGHEST for action port [ 706.578229] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.578338] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.578576] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.578669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.578978] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.579091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.579159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.579370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.579447] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.726173] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.726391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.726391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.726764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.726764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.726764] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 already deleted. [ 706.726948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.082846] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e with status ACTIVE [ 707.083102] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.083213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.083303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.083676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.083775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.083970] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.084087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.084147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.084319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.084397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.086704] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.086704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.086704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.086704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.086704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.086704] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e is going to be updated. [ 707.107533] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.107661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.107724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.107999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.108154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.108617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b92b3662-6d4c-4ad4-9bd1-567dc0d0d91e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.404927] env[66730]: INFO networking_nsxv3.common.synchronization [req-38cdc1ac-17c5-44a0-8164-ef30ce536762 req-528e135d-2f9f-4aa8-a08d-fa5fed15a3c6 tempest-AttachInterfacesV270Test-1285807283 tempest-AttachInterfacesV270Test-1285807283-project-member] Enqueued Resource ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad with Priority: HIGHEST for action security_group_members [ 707.409647] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad with Priority: HIGHEST for action security_group_members [ 707.409843] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5879e874-e4a6-4ef8-9300-0b701b2512ad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.410641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.410641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.410641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.410641] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.410641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.410847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.410847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.410935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.411055] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5879e874-e4a6-4ef8-9300-0b701b2512ad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.451474] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 707.451686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.451947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.452094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.452272] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.452382] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.452492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.452731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.452731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.452894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.452894] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.453711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.454054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.454137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.454243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.454306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.454448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.454528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.454633] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.702641] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 in Status: SUCCESS [ 707.702641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.803774] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-539 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.804237] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-539" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.804428] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-539" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.804786] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-539" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.805224] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.805406] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.805523] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.805756] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.806184] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.806411] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.806520] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.806628] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.806731] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.806836] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.806936] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.807081] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.827263] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.827463] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.827595] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.827772] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-539" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.828188] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-45f57ed1-ea88-46ce-80c1-59f263144992 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.828392] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-45f57ed1-ea88-46ce-80c1-59f263144992" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.828584] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-45f57ed1-ea88-46ce-80c1-59f263144992" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.828938] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-45f57ed1-ea88-46ce-80c1-59f263144992" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.829086] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f57ed1-ea88-46ce-80c1-59f263144992',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.913823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.914116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.914245] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.914508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.914648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.914884] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.915049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.915175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.915395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.915522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.915645] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad already deleted. [ 707.915765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.956761] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.957256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.957528] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.332607] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.332880] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.332914] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.333260] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.333322] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.333471] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 45f57ed1-ea88-46ce-80c1-59f263144992 not found, creating... [ 708.333734] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.333885] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.334299] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.334299] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.334397] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.335346] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.335346] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.335346] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.335346] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.335845] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.335845] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 45f57ed1-ea88-46ce-80c1-59f263144992 is going to be created. [ 708.356509] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.356509] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.356509] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.356913] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.357079] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.357292] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-45f57ed1-ea88-46ce-80c1-59f263144992" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.460298] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.784596] env[66730]: INFO networking_nsxv3.common.synchronization [None req-698a654c-a5eb-426e-ad29-c85c6e976f92 None None] Enqueued Resource ID: 6645185f-7bb8-4cc1-81b5-a86a215edcde with Priority: HIGHEST for action port [ 708.784596] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6645185f-7bb8-4cc1-81b5-a86a215edcde with Priority: HIGHEST for action port [ 708.784890] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-6645185f-7bb8-4cc1-81b5-a86a215edcde taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.785199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6645185f-7bb8-4cc1-81b5-a86a215edcde" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.785309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6645185f-7bb8-4cc1-81b5-a86a215edcde" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.785575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6645185f-7bb8-4cc1-81b5-a86a215edcde" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.785647] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6645185f-7bb8-4cc1-81b5-a86a215edcde',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.964188] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.964188] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.964355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.964747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.964747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.964859] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 709.000438] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.000554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.000591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.000835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.001034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.014760] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 709.099683] env[66730]: INFO networking_nsxv3.common.synchronization [req-38cdc1ac-17c5-44a0-8164-ef30ce536762 req-5f94fe56-497b-4436-a904-1df2c11f9686 service nova] Enqueued Resource ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad with Priority: HIGHEST for action security_group_rules [ 709.099781] env[66730]: INFO networking_nsxv3.common.synchronization [req-38cdc1ac-17c5-44a0-8164-ef30ce536762 req-5f94fe56-497b-4436-a904-1df2c11f9686 service nova] Enqueued Resource ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad with Priority: HIGHEST for action security_group_members [ 709.099821] env[66730]: INFO networking_nsxv3.common.synchronization [req-38cdc1ac-17c5-44a0-8164-ef30ce536762 req-5f94fe56-497b-4436-a904-1df2c11f9686 service nova] Enqueued Resource ID: 45f57ed1-ea88-46ce-80c1-59f263144992 with Priority: HIGHEST for action port [ 709.100435] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad with Priority: HIGHEST for action security_group_rules [ 709.100565] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad with Priority: HIGHEST for action security_group_members [ 709.100659] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f57ed1-ea88-46ce-80c1-59f263144992 with Priority: HIGHEST for action port [ 709.100945] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5879e874-e4a6-4ef8-9300-0b701b2512ad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.101322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.101402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.101714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.101757] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5879e874-e4a6-4ef8-9300-0b701b2512ad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.104862] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5879e874-e4a6-4ef8-9300-0b701b2512ad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.104862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.104862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.104862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.104862] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.104862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.104862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.104862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.104862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.104862] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5879e874-e4a6-4ef8-9300-0b701b2512ad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.104862] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-45f57ed1-ea88-46ce-80c1-59f263144992 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.104862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45f57ed1-ea88-46ce-80c1-59f263144992" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.104862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45f57ed1-ea88-46ce-80c1-59f263144992" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.105598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45f57ed1-ea88-46ce-80c1-59f263144992" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.105598] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f57ed1-ea88-46ce-80c1-59f263144992',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.288009] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6645185f-7bb8-4cc1-81b5-a86a215edcde [ 709.288263] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.288348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.288393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.288687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.288687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.288771] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6645185f-7bb8-4cc1-81b5-a86a215edcde already deleted. [ 709.288879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6645185f-7bb8-4cc1-81b5-a86a215edcde" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.610020] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5879e874-e4a6-4ef8-9300-0b701b2512ad taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.610020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.610020] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5879e874-e4a6-4ef8-9300-0b701b2512ad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.610020] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45f57ed1-ea88-46ce-80c1-59f263144992 with status ACTIVE [ 709.610020] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.610020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.610020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.610020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.610020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.610020] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.610020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.610020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.610800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.610800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.611721] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.611721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.611721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.611721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.611916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.611916] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45f57ed1-ea88-46ce-80c1-59f263144992 is going to be updated. [ 709.635839] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.636063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.640033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.640033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.640033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.640033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45f57ed1-ea88-46ce-80c1-59f263144992" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.109611] env[66730]: INFO networking_nsxv3.common.synchronization [req-16ce1724-25e4-426f-a8b2-1e4524814612 req-4b1b8afa-98f1-40b6-bd41-4d8b37bacb76 tempest-ServersAdminNegativeTestJSON-140283744 tempest-ServersAdminNegativeTestJSON-140283744-project-member] Enqueued Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 710.110247] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 710.110582] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.110707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.110775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.112692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.112923] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.113068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.113138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.113413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.113511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.113618] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.116372] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5879e874-e4a6-4ef8-9300-0b701b2512ad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.538955] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.539161] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.539474] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.540903] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.540903] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.540903] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.540903] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.540903] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.540903] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.540903] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.540903] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.540903] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.540903] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.541245] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.541278] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.541403] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.561975] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.562188] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.562320] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.562522] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.563023] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-7586796c-cf9f-4e46-92eb-3a3b939cd2a6 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.563023] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-7586796c-cf9f-4e46-92eb-3a3b939cd2a6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.563397] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-7586796c-cf9f-4e46-92eb-3a3b939cd2a6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.563397] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-7586796c-cf9f-4e46-92eb-3a3b939cd2a6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.563999] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7586796c-cf9f-4e46-92eb-3a3b939cd2a6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.617051] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.617051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.617051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.617051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.617051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.617573] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.617573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.617573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.617573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.617573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.617805] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d already deleted. [ 710.617805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.618088] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.618203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.618261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.618426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.618476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.618563] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad is going to be created. [ 710.646312] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.646505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.646598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.646816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.646980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.658499] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad in Status: UNINITIALIZED for 2s [ 711.026579] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 711.027287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.027464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.028246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.028246] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.028246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.028246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.028246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.028444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.028444] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.067535] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.067682] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.067801] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.068219] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.068316] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.068632] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 7586796c-cf9f-4e46-92eb-3a3b939cd2a6 not found, creating... [ 711.068748] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.068942] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.069105] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.069298] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.069468] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.069778] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.069953] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.071019] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.071918] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.072126] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.072317] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 7586796c-cf9f-4e46-92eb-3a3b939cd2a6 is going to be created. [ 711.094109] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.094109] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.094109] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.094360] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.094505] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.094885] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-7586796c-cf9f-4e46-92eb-3a3b939cd2a6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.186647] env[66730]: INFO networking_nsxv3.common.synchronization [req-2a7f7d42-c5c0-4858-997e-8aa187fe847e req-6cf22929-a41a-4846-87e8-0af21a3c0221 tempest-SecurityGroupRulesTestJSON-2033598309 tempest-SecurityGroupRulesTestJSON-2033598309-project-member] Enqueued Resource ID: 4f78b669-3c64-4c8d-b35c-2eee9d1828ba with Priority: HIGHEST for action security_group_rules [ 711.187178] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f78b669-3c64-4c8d-b35c-2eee9d1828ba with Priority: HIGHEST for action security_group_rules [ 711.187482] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f78b669-3c64-4c8d-b35c-2eee9d1828ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.187604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f78b669-3c64-4c8d-b35c-2eee9d1828ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.187670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f78b669-3c64-4c8d-b35c-2eee9d1828ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.187972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f78b669-3c64-4c8d-b35c-2eee9d1828ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.188114] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f78b669-3c64-4c8d-b35c-2eee9d1828ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.303387] env[66730]: INFO networking_nsxv3.common.synchronization [None req-735656b5-ea3c-424e-ae4e-11625a04bd34 None None] Enqueued Resource ID: d21cd6b5-4e3d-4a51-8317-b3b47cf8e899 with Priority: HIGHEST for action port [ 711.303387] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21cd6b5-4e3d-4a51-8317-b3b47cf8e899 with Priority: HIGHEST for action port [ 711.304159] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d21cd6b5-4e3d-4a51-8317-b3b47cf8e899 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.304159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d21cd6b5-4e3d-4a51-8317-b3b47cf8e899" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.304159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d21cd6b5-4e3d-4a51-8317-b3b47cf8e899" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.305605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d21cd6b5-4e3d-4a51-8317-b3b47cf8e899" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.305605] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d21cd6b5-4e3d-4a51-8317-b3b47cf8e899',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.531417] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.710467] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.710785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.710785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.710993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.710993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.711130] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f78b669-3c64-4c8d-b35c-2eee9d1828ba already deleted. [ 711.711130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f78b669-3c64-4c8d-b35c-2eee9d1828ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.806987] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d21cd6b5-4e3d-4a51-8317-b3b47cf8e899 [ 711.806987] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.807165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.807165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.807587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.807587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.807681] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d21cd6b5-4e3d-4a51-8317-b3b47cf8e899 already deleted. [ 711.807752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d21cd6b5-4e3d-4a51-8317-b3b47cf8e899" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.896028] env[66730]: INFO networking_nsxv3.common.synchronization [req-16ce1724-25e4-426f-a8b2-1e4524814612 req-4952d2bf-dd4a-491c-a22c-ee9814e8a861 service nova] Enqueued Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_rules [ 711.896288] env[66730]: INFO networking_nsxv3.common.synchronization [req-16ce1724-25e4-426f-a8b2-1e4524814612 req-4952d2bf-dd4a-491c-a22c-ee9814e8a861 service nova] Enqueued Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 711.896424] env[66730]: INFO networking_nsxv3.common.synchronization [req-16ce1724-25e4-426f-a8b2-1e4524814612 req-4952d2bf-dd4a-491c-a22c-ee9814e8a861 service nova] Enqueued Resource ID: 7586796c-cf9f-4e46-92eb-3a3b939cd2a6 with Priority: HIGHEST for action port [ 711.897236] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_rules [ 711.897236] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 711.897236] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7586796c-cf9f-4e46-92eb-3a3b939cd2a6 with Priority: HIGHEST for action port [ 711.897478] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.897600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.897666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.897945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.898041] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.898978] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.899104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.899171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.899341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.899491] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.899586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.899647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.899784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.899868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.899980] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.901219] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-7586796c-cf9f-4e46-92eb-3a3b939cd2a6 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.901219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7586796c-cf9f-4e46-92eb-3a3b939cd2a6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.901312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7586796c-cf9f-4e46-92eb-3a3b939cd2a6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.901419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7586796c-cf9f-4e46-92eb-3a3b939cd2a6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.901487] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7586796c-cf9f-4e46-92eb-3a3b939cd2a6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.033481] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.403526] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.404283] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.404353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.405458] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7586796c-cf9f-4e46-92eb-3a3b939cd2a6 with status ACTIVE [ 712.405458] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.405458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.405458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.405458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.405458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.405458] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.405458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.405458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.407369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.407369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.407369] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.407369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.407369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.407369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.407369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.407369] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7586796c-cf9f-4e46-92eb-3a3b939cd2a6 is going to be updated. [ 712.439673] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.439822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.439929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.440342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.440475] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.440641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7586796c-cf9f-4e46-92eb-3a3b939cd2a6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.492120] env[66730]: INFO networking_nsxv3.common.synchronization [req-32d69c53-1462-4863-9e90-324b007c15d8 req-9c1dad89-5c97-4815-b795-91ac1649191c tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_members [ 712.492681] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_members [ 712.493120] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d40e47e-8889-4be5-a560-287881831b93 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.493259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.493325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.494082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.494082] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.494082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.494082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.495167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.495167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.495167] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d40e47e-8889-4be5-a560-287881831b93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.538031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.538031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.538031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.538031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.538031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.538031] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 712.577596] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.577596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.577596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.577810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.579023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.591808] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 712.668824] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad in Status: SUCCESS [ 712.669107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.669282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.669568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.669779] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.669912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.670102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.670908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.670908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.670908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.670908] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5879e874-e4a6-4ef8-9300-0b701b2512ad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.909935] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.997599] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.997599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.997599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.997599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.997599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.998058] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.998232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.998302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.998552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.998704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.998821] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d40e47e-8889-4be5-a560-287881831b93 already deleted. [ 712.998961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.011274] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.011461] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.011518] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.011816] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.012254] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.012432] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.012533] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.012743] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.012880] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.013103] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.013933] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.013933] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.013933] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.013933] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.013933] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.013933] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.050037] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.050172] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 713.050332] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.050531] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.050904] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-8757cfed-9cdd-47aa-a385-bd93ef86c9d8 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.051174] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-8757cfed-9cdd-47aa-a385-bd93ef86c9d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.052368] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-8757cfed-9cdd-47aa-a385-bd93ef86c9d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.052368] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-8757cfed-9cdd-47aa-a385-bd93ef86c9d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.052669] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8757cfed-9cdd-47aa-a385-bd93ef86c9d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.173282] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5879e874-e4a6-4ef8-9300-0b701b2512ad taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.173425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.173472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.173743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.174090] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.174090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.174208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.174384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.174736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.174736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.174736] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5879e874-e4a6-4ef8-9300-0b701b2512ad taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.174880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.174880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.175103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.175200] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.175361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.175528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.175998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.175998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.175998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.175998] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5879e874-e4a6-4ef8-9300-0b701b2512ad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.415093] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.415093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.415093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.415093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.415093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.415093] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d is going to be created. [ 713.443455] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.443455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.443455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.443455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.443989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.457147] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: UNINITIALIZED for 2s [ 713.558413] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.559532] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.562030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.562030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.562030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.562030] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 8757cfed-9cdd-47aa-a385-bd93ef86c9d8 not found, creating... [ 713.562030] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.562030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.562030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.562030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.562030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.562982] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.563518] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.563789] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.564487] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.565956] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.566698] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 8757cfed-9cdd-47aa-a385-bd93ef86c9d8 is going to be created. [ 713.591816] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.591816] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.592057] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.592290] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.592569] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.592867] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-8757cfed-9cdd-47aa-a385-bd93ef86c9d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.680584] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5879e874-e4a6-4ef8-9300-0b701b2512ad: rpc.has_security_group_logging(os_id): False [ 713.705517] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.705741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.705741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.706070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.706231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.706534] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.706710] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.706818] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.707046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.707169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.707438] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.707572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.707661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.707842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.708768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.709187] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.709187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.709355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.709424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.709469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.709567] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad is going to be created. [ 713.790747] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.791023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.791023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.791188] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.791361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.803999] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad in Status: IN_PROGRESS for 2s [ 714.185968] env[66730]: INFO networking_nsxv3.common.synchronization [req-c40426b0-1328-4399-8343-cfcaa9753377 req-a782ab88-df98-45ae-8b23-9c7194409aa9 tempest-FloatingIPsAssociationTestJSON-1582201638 tempest-FloatingIPsAssociationTestJSON-1582201638-project-member] Enqueued Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 714.186300] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGHEST for action security_group_members [ 714.186751] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.187158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.187158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.187508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.187887] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.187887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.187887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.188080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.189051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.189051] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.396591] env[66730]: INFO networking_nsxv3.common.synchronization [req-32d69c53-1462-4863-9e90-324b007c15d8 req-9381220a-b127-4d85-af2e-bac701f189de service nova] Enqueued Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_rules [ 714.397475] env[66730]: INFO networking_nsxv3.common.synchronization [req-32d69c53-1462-4863-9e90-324b007c15d8 req-9381220a-b127-4d85-af2e-bac701f189de service nova] Enqueued Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_members [ 714.397753] env[66730]: INFO networking_nsxv3.common.synchronization [req-32d69c53-1462-4863-9e90-324b007c15d8 req-9381220a-b127-4d85-af2e-bac701f189de service nova] Enqueued Resource ID: 8757cfed-9cdd-47aa-a385-bd93ef86c9d8 with Priority: HIGHEST for action port [ 714.399367] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_rules [ 714.399650] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_members [ 714.399866] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8757cfed-9cdd-47aa-a385-bd93ef86c9d8 with Priority: HIGHEST for action port [ 714.400267] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d40e47e-8889-4be5-a560-287881831b93 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.400418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.400526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.400905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.400905] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d40e47e-8889-4be5-a560-287881831b93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.405370] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d40e47e-8889-4be5-a560-287881831b93 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.405370] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.405370] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d40e47e-8889-4be5-a560-287881831b93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.405370] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-8757cfed-9cdd-47aa-a385-bd93ef86c9d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8757cfed-9cdd-47aa-a385-bd93ef86c9d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8757cfed-9cdd-47aa-a385-bd93ef86c9d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8757cfed-9cdd-47aa-a385-bd93ef86c9d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.405370] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8757cfed-9cdd-47aa-a385-bd93ef86c9d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.605740] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 714.605995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.606191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.606409] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.606627] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.606844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.606844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.607264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.607264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.607264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.607418] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.607418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.607503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.607642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.607767] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.607863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.608111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.608148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.608225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.608377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.608461] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.691820] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.692150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.692937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.693268] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.693664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.693965] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.694139] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.694236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.694428] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.694562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.694661] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 is going to be updated. [ 714.726061] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.726224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.726539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.726539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.726728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.741311] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: IN_PROGRESS for 2s [ 714.816064] env[66730]: INFO networking_nsxv3.common.synchronization [req-e08a141e-d2f9-4956-b2a3-33ac9fe1303c req-2e0cf50f-e148-492c-8b56-23c2d2512ead tempest-ServerAddressesTestJSON-730458700 tempest-ServerAddressesTestJSON-730458700-project-member] Enqueued Resource ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a with Priority: HIGHEST for action security_group_members [ 714.816782] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a with Priority: HIGHEST for action security_group_members [ 714.817117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-34c5c58e-4b22-4273-bd10-70b2a85bf96a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.817233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.817298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.817509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.817659] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.817750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.817807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.818521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.818521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.818521] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34c5c58e-4b22-4273-bd10-70b2a85bf96a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.907400] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d40e47e-8889-4be5-a560-287881831b93 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.907400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.907400] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d40e47e-8889-4be5-a560-287881831b93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.908279] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8757cfed-9cdd-47aa-a385-bd93ef86c9d8 with status ACTIVE [ 714.909110] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.909110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.909110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.910732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.910845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.911102] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.911219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.911284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.911463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.911545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.911799] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.911917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.912015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.912142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.912240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.912298] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8757cfed-9cdd-47aa-a385-bd93ef86c9d8 is going to be updated. [ 714.935371] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.935541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.935589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.935969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.936063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.936349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8757cfed-9cdd-47aa-a385-bd93ef86c9d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.112127] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4155358-3708-4cf2-b2a6-fe099ab35896: rpc.has_security_group_logging(os_id): False [ 715.132127] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.132127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.132593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.132593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.132689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.133511] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.133511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.133511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.133511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.133511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.133888] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.133888] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.133888] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.134165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.136713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.136993] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.137661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.137732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.137905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.138031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.138124] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be created. [ 715.235393] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.235393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.235393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.237081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.237081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.252620] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 715.323161] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.323161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.323161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.323161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.323547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.323829] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.323939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.324011] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.326206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.326304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.326421] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a is going to be updated. [ 715.385353] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.385353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.385353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.385353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.385353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.404040] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a in Status: IN_PROGRESS for 2s [ 715.414764] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d40e47e-8889-4be5-a560-287881831b93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.468703] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: SUCCESS [ 715.468878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.469114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.469618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.469618] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.469751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.469784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.469977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.470118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.470257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.470411] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.825265] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad in Status: SUCCESS [ 715.825265] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.919086] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.919291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.919370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.921133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.921295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.921410] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d40e47e-8889-4be5-a560-287881831b93 is going to be created. [ 715.951222] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.951351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.951418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.951634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.951783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.966023] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d40e47e-8889-4be5-a560-287881831b93 in Status: UNINITIALIZED for 2s [ 715.974134] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.974134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.974394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.974469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.975057] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.975057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.975177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.975369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.975426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.975551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.975975] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.975975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.975975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.976092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.976247] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.976351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.976415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.976585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.976730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.976763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.976840] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.480564] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398600ce-6668-4055-9c7c-d60ad413bf9d: rpc.has_security_group_logging(os_id): False [ 716.504912] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.504912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.504912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.505228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.505228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.505684] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.505684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.505684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.505684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.505935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.505935] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.506094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.506094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.506224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.506299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.506480] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.506574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.506702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.506788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.506839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.506926] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d is going to be created. [ 716.589375] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.589375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.589499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.589696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.589914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.621997] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: IN_PROGRESS for 2s [ 716.756914] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 in Status: SUCCESS [ 716.757122] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 deletion is rescheduled due to dependency. [ 716.757239] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.167961] env[66730]: INFO networking_nsxv3.common.synchronization [req-e4f1a3c6-3db3-40f5-aceb-07c836883cc9 req-19d2c20a-ac03-4d51-ab41-6f7e45878457 tempest-SecurityGroupRulesTestJSON-2033598309 tempest-SecurityGroupRulesTestJSON-2033598309-project-member] Enqueued Resource ID: ec7fbae4-1c05-4291-ade7-85168d9b596f with Priority: HIGHEST for action security_group_rules [ 717.168536] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7fbae4-1c05-4291-ade7-85168d9b596f with Priority: HIGHEST for action security_group_rules [ 717.169237] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec7fbae4-1c05-4291-ade7-85168d9b596f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.169237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec7fbae4-1c05-4291-ade7-85168d9b596f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.169237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec7fbae4-1c05-4291-ade7-85168d9b596f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.169372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec7fbae4-1c05-4291-ade7-85168d9b596f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.169372] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec7fbae4-1c05-4291-ade7-85168d9b596f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.265893] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 717.266159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.266415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.266630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.266693] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.419351] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a in Status: SUCCESS [ 717.419351] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34c5c58e-4b22-4273-bd10-70b2a85bf96a deletion is rescheduled due to dependency. [ 717.419351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34c5c58e-4b22-4273-bd10-70b2a85bf96a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.696685] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.697095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.697095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.699935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.699935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.699935] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec7fbae4-1c05-4291-ade7-85168d9b596f already deleted. [ 717.699935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec7fbae4-1c05-4291-ade7-85168d9b596f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.770211] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.770376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.770461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.770763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.770903] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.770991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.770991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.771293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.773014] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.773014] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.773014] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.976707] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d40e47e-8889-4be5-a560-287881831b93 in Status: SUCCESS [ 717.979748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.979748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.979748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.979748] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.979748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.979748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.979748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.979748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.979748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.979748] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d40e47e-8889-4be5-a560-287881831b93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.277210] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.277210] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.277210] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.277210] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.277210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.277728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.277728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.277728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.277728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.277728] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.480141] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d40e47e-8889-4be5-a560-287881831b93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.636805] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: SUCCESS [ 718.637075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.781119] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4155358-3708-4cf2-b2a6-fe099ab35896: rpc.has_security_group_logging(os_id): False [ 718.801834] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.802069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.802069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.802289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.802379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.802661] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.802835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.802903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.803077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.803161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.803374] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.803487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.803549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.803693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.803767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.803981] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.804098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.804160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.804325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.804442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.804848] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 718.888556] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.888828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.888828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.889107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.889391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.906974] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 718.988051] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d40e47e-8889-4be5-a560-287881831b93: rpc.has_security_group_logging(os_id): False [ 719.042683] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.042895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.042947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.043320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.043438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.043726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.043842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.043898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.044114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.044244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.044302] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d40e47e-8889-4be5-a560-287881831b93 is going to be created. [ 719.120477] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.120705] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.120785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.121142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.121715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.138321] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d40e47e-8889-4be5-a560-287881831b93 in Status: IN_PROGRESS for 2s [ 720.389028] env[66730]: INFO networking_nsxv3.common.synchronization [req-8a990779-d59a-4a1a-a2cd-080636426995 req-03b40eb5-3c9c-4216-a8c8-93688a230ba2 tempest-ImagesOneServerNegativeTestJSON-160835856 tempest-ImagesOneServerNegativeTestJSON-160835856-project-member] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 720.389028] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 720.389028] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.389028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.389028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.389028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.389028] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.389028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.389028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.389028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.389028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.389028] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.891992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.891992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.891992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.891992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.891992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.891992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.891992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.891992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.892440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.892440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.892440] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be updated. [ 720.922404] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 720.922607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.930117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.930226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.930280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.930857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.930857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.948403] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: IN_PROGRESS for 2s [ 720.988565] env[66730]: INFO networking_nsxv3.common.synchronization [None req-09fefff6-fb44-4e44-be93-7bd3ba575c8b None None] Enqueued Resource ID: b87655e3-0ee1-482e-809f-831350337708 with Priority: HIGHEST for action port [ 720.989435] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b87655e3-0ee1-482e-809f-831350337708 with Priority: HIGHEST for action port [ 720.989435] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b87655e3-0ee1-482e-809f-831350337708 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.989585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b87655e3-0ee1-482e-809f-831350337708" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.989621] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b87655e3-0ee1-482e-809f-831350337708" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.989864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b87655e3-0ee1-482e-809f-831350337708" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.989942] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b87655e3-0ee1-482e-809f-831350337708',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.060550] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.060550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.060550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.060550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.060550] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.060550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.060550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.060550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.060961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.060961] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.061070] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.061136] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.061239] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.061337] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.061433] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.061579] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.084126] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.084293] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.084422] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.084580] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.085168] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-5736d3aa-a8e1-445a-8aba-d66245588ee4 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.085454] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-5736d3aa-a8e1-445a-8aba-d66245588ee4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.085576] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-5736d3aa-a8e1-445a-8aba-d66245588ee4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.085955] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-5736d3aa-a8e1-445a-8aba-d66245588ee4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.086469] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5736d3aa-a8e1-445a-8aba-d66245588ee4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.152668] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d40e47e-8889-4be5-a560-287881831b93 in Status: SUCCESS [ 721.152668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.493725] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b87655e3-0ee1-482e-809f-831350337708 [ 721.493974] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.494118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.494188] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.494407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.494651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.494798] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b87655e3-0ee1-482e-809f-831350337708 already deleted. [ 721.494923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b87655e3-0ee1-482e-809f-831350337708" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.589289] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.589576] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.589721] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.590115] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.590291] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.590466] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 5736d3aa-a8e1-445a-8aba-d66245588ee4 not found, creating... [ 721.591011] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.591233] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.591381] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.591698] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.591890] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.592374] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.592540] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.592728] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.593114] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.593341] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.593578] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 5736d3aa-a8e1-445a-8aba-d66245588ee4 is going to be created. [ 721.615952] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.616184] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.616316] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.616616] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.616861] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.617122] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-5736d3aa-a8e1-445a-8aba-d66245588ee4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.282233] env[66730]: INFO networking_nsxv3.common.synchronization [req-4b2d95b2-0dfb-4c49-9146-71485eb31614 req-56a2e4fe-11fd-42c7-a835-2adfbf67d38a tempest-ServersNegativeTestJSON-256798717 tempest-ServersNegativeTestJSON-256798717-project-member] Enqueued Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 722.282897] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 722.283501] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.283501] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.283501] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.283846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.283846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.283846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.283846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.284096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.284096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.284187] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.322671] env[66730]: INFO networking_nsxv3.common.synchronization [req-8a990779-d59a-4a1a-a2cd-080636426995 req-00bea57f-4d38-4759-869e-dc1a0c7c62da service nova] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_rules [ 722.322841] env[66730]: INFO networking_nsxv3.common.synchronization [req-8a990779-d59a-4a1a-a2cd-080636426995 req-00bea57f-4d38-4759-869e-dc1a0c7c62da service nova] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 722.322993] env[66730]: INFO networking_nsxv3.common.synchronization [req-8a990779-d59a-4a1a-a2cd-080636426995 req-00bea57f-4d38-4759-869e-dc1a0c7c62da service nova] Enqueued Resource ID: 5736d3aa-a8e1-445a-8aba-d66245588ee4 with Priority: HIGHEST for action port [ 722.323240] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_rules [ 722.323379] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 722.323487] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5736d3aa-a8e1-445a-8aba-d66245588ee4 with Priority: HIGHEST for action port [ 722.323992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.324366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.324465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.324630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.324710] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.326311] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.326380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.326585] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-5736d3aa-a8e1-445a-8aba-d66245588ee4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.326784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5736d3aa-a8e1-445a-8aba-d66245588ee4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.326784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5736d3aa-a8e1-445a-8aba-d66245588ee4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.326908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5736d3aa-a8e1-445a-8aba-d66245588ee4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.327716] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5736d3aa-a8e1-445a-8aba-d66245588ee4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.768491] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.768911] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.768911] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.769585] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.769812] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.769968] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.770095] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.770363] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.770536] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.770754] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.770858] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.770958] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.771077] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.771182] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.771280] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.771411] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.788206] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.802630] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.802782] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.802910] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.803121] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.803451] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-43db2364-aa93-4f6f-9b23-6674a827c0e0 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.803628] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-43db2364-aa93-4f6f-9b23-6674a827c0e0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.803767] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-43db2364-aa93-4f6f-9b23-6674a827c0e0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.804098] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-43db2364-aa93-4f6f-9b23-6674a827c0e0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.804275] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43db2364-aa93-4f6f-9b23-6674a827c0e0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.832312] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.832312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.832312] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5736d3aa-a8e1-445a-8aba-d66245588ee4 with status ACTIVE [ 722.832312] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.832312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.832312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.832312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.832312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.832312] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.832312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.832312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.832312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.832312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.832312] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.832811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.832811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.832811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.832811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.832811] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5736d3aa-a8e1-445a-8aba-d66245588ee4 is going to be updated. [ 722.880605] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.880788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.880834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.881050] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.881192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.881349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5736d3aa-a8e1-445a-8aba-d66245588ee4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.960868] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: SUCCESS [ 722.961070] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a deletion is rescheduled due to dependency. [ 722.961184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.961642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.961864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.962064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.962310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.962768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.963007] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.963105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.963207] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.289572] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.309153] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.309153] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.309153] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.309319] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.309564] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.309729] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 43db2364-aa93-4f6f-9b23-6674a827c0e0 not found, creating... [ 723.309978] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.310151] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.310320] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.310569] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.310753] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.311121] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.311331] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.311455] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.311715] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.311863] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.312049] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 43db2364-aa93-4f6f-9b23-6674a827c0e0 is going to be created. [ 723.367433] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.367774] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.368023] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.369216] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.369216] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.369216] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-43db2364-aa93-4f6f-9b23-6674a827c0e0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.464913] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.521889] env[66730]: INFO networking_nsxv3.common.synchronization [None req-9738ed52-7de1-4448-9c2e-543994665ac3 None None] Enqueued Resource ID: bd4616e3-6610-4faa-a3cf-50060c945251 with Priority: HIGHEST for action port [ 723.522409] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd4616e3-6610-4faa-a3cf-50060c945251 with Priority: HIGHEST for action port [ 723.522823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd4616e3-6610-4faa-a3cf-50060c945251 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.522823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd4616e3-6610-4faa-a3cf-50060c945251" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.523167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd4616e3-6610-4faa-a3cf-50060c945251" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.523215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd4616e3-6610-4faa-a3cf-50060c945251" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.525045] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd4616e3-6610-4faa-a3cf-50060c945251',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.792330] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.793332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.793332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.793332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.793332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.793332] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc is going to be updated. [ 723.824452] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.824615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.824649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.824870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.825019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.834356] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: IN_PROGRESS for 2s [ 723.967414] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.020950] env[66730]: INFO networking_nsxv3.common.synchronization [req-4b2d95b2-0dfb-4c49-9146-71485eb31614 req-abbdd8e1-1c19-4c88-9a74-c210b75c2fcb service nova] Enqueued Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_rules [ 724.020950] env[66730]: INFO networking_nsxv3.common.synchronization [req-4b2d95b2-0dfb-4c49-9146-71485eb31614 req-abbdd8e1-1c19-4c88-9a74-c210b75c2fcb service nova] Enqueued Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 724.021148] env[66730]: INFO networking_nsxv3.common.synchronization [req-4b2d95b2-0dfb-4c49-9146-71485eb31614 req-abbdd8e1-1c19-4c88-9a74-c210b75c2fcb service nova] Enqueued Resource ID: 43db2364-aa93-4f6f-9b23-6674a827c0e0 with Priority: HIGHEST for action port [ 724.024221] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_rules [ 724.024221] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 724.029218] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43db2364-aa93-4f6f-9b23-6674a827c0e0 with Priority: HIGHEST for action port [ 724.029218] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.029218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.029218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.029218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.029218] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.031401] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd4616e3-6610-4faa-a3cf-50060c945251 [ 724.033220] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.033423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.033592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.033993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.033993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.034205] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd4616e3-6610-4faa-a3cf-50060c945251 already deleted. [ 724.034355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd4616e3-6610-4faa-a3cf-50060c945251" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.034909] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.035783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.036129] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-43db2364-aa93-4f6f-9b23-6674a827c0e0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.036406] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43db2364-aa93-4f6f-9b23-6674a827c0e0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.036532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43db2364-aa93-4f6f-9b23-6674a827c0e0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.037090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43db2364-aa93-4f6f-9b23-6674a827c0e0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.037090] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43db2364-aa93-4f6f-9b23-6674a827c0e0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.470113] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.470282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.470379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.470567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.470654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.470746] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be updated. [ 724.503111] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.503342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.503457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.503734] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.503964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.516096] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: IN_PROGRESS for 2s [ 724.538820] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.538954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.539181] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43db2364-aa93-4f6f-9b23-6674a827c0e0 with status ACTIVE [ 724.539356] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.539471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.539530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.539745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.539826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.539996] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.540116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.540175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.540309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.540387] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.540576] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.540667] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.540853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.540913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.541057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.541057] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43db2364-aa93-4f6f-9b23-6674a827c0e0 is going to be updated. [ 724.574951] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.575170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.575268] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.575537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.575720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.575862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43db2364-aa93-4f6f-9b23-6674a827c0e0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.850511] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: SUCCESS [ 725.850791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.850907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.852378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.852623] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.852800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.852868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.853075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.853167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.853268] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.122408] env[66730]: INFO networking_nsxv3.common.synchronization [req-268f48e3-83e8-447c-b17d-93125d93903f req-7cb1171e-d3cd-4d15-9553-bb05a83d4dde tempest-SecurityGroupRulesTestJSON-2033598309 tempest-SecurityGroupRulesTestJSON-2033598309-project-member] Enqueued Resource ID: e7df896f-39aa-4236-b8bc-f66a1fd02f34 with Priority: HIGHEST for action security_group_rules [ 726.122408] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7df896f-39aa-4236-b8bc-f66a1fd02f34 with Priority: HIGHEST for action security_group_rules [ 726.122634] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.122750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.122811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.123182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.123561] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7df896f-39aa-4236-b8bc-f66a1fd02f34',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.355662] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.529907] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: SUCCESS [ 726.529907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.529907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.530442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.531049] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.531180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.531761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.531761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.531761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.531959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.531959] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.646693] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.646979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.647114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.647390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.647482] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.647651] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7df896f-39aa-4236-b8bc-f66a1fd02f34 already deleted. [ 726.647856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.858406] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.034921] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.035104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.035169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.035391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.035669] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.035669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.036112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.037385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.037636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.037636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.037830] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.038273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.038459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.038699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.038982] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.039130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.039215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.039628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.040492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.040640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.040807] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.365868] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.365868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.366060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.366275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.366275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.366423] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc is going to be updated. [ 727.389071] env[66730]: INFO networking_nsxv3.common.synchronization [req-5871c988-6be4-45c6-a8af-9f60d971db74 req-323a6bd8-21e0-4082-8887-3d09481ad8bb tempest-SecurityGroupRulesTestJSON-2033598309 tempest-SecurityGroupRulesTestJSON-2033598309-project-member] Enqueued Resource ID: e7df896f-39aa-4236-b8bc-f66a1fd02f34 with Priority: HIGHEST for action security_group_rules [ 727.389676] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7df896f-39aa-4236-b8bc-f66a1fd02f34 with Priority: HIGHEST for action security_group_rules [ 727.389990] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.390151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.390253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.390584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.390584] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7df896f-39aa-4236-b8bc-f66a1fd02f34',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.402074] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.402471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.402580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.404051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.404051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.414714] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: IN_PROGRESS for 2s [ 727.548012] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c63f5ef2-5b7c-4817-aa38-f459fffee01a: rpc.has_security_group_logging(os_id): False [ 727.568454] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.568454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.568454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.568454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.568454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.568454] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.568454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.568454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.568911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.568911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.572145] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.572145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.572145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.572145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.572145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.572145] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.572145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.572145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.572145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.572145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.572145] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be updated. [ 727.690044] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.690044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.690044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.690044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.690433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.720164] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: IN_PROGRESS for 2s [ 727.915176] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.915514] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.915514] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.915795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.915795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.915795] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7df896f-39aa-4236-b8bc-f66a1fd02f34 already deleted. [ 727.915890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.935162] env[66730]: INFO networking_nsxv3.common.synchronization [req-cec7fb83-a664-4ffe-abb2-e4c2b889bfa1 req-c2c35c38-9912-4ce8-b97f-475d52c05ca2 tempest-AttachInterfacesV270Test-1285807283 tempest-AttachInterfacesV270Test-1285807283-project-member] Enqueued Resource ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad with Priority: HIGHEST for action security_group_members [ 727.935684] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad with Priority: HIGHEST for action security_group_members [ 727.935983] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5879e874-e4a6-4ef8-9300-0b701b2512ad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.936109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.936171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.936375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.936526] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.936622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.936680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.936838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.936942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.938283] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5879e874-e4a6-4ef8-9300-0b701b2512ad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.440465] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.440897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.440897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.441197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.441317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.441565] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.441737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.441822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.442035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.442173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.442322] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad is going to be updated. [ 728.475545] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.475545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.475545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.475545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.475545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.488830] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad in Status: IN_PROGRESS for 2s [ 729.330014] env[66730]: INFO networking_nsxv3.common.synchronization [req-ca57717c-4297-4963-a316-8d791c6c90dd req-985b4d39-11b0-4029-b235-72f7753ed0ef tempest-ServersWithSpecificFlavorTestJSON-740738296 tempest-ServersWithSpecificFlavorTestJSON-740738296-project-member] Enqueued Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 729.330805] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 729.331711] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.331838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.331903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.332115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.332262] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.332408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.332408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.333530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.333530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.333530] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.427103] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: SUCCESS [ 729.427322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.427322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.427322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.428280] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.428280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.428280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.428656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.428656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.428656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.428656] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.734149] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: SUCCESS [ 729.734390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.838382] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.838565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.838629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.838853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.838944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.842371] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.842566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.842657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.842964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.843086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.843178] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 is going to be updated. [ 729.873863] env[66730]: INFO networking_nsxv3.common.synchronization [req-0aed81b7-5487-4c75-b13a-a94e9dd3d425 req-e8c041be-0cc4-4742-96c7-d9f8327d9e24 tempest-SecurityGroupRulesTestJSON-2033598309 tempest-SecurityGroupRulesTestJSON-2033598309-project-member] Enqueued Resource ID: e7df896f-39aa-4236-b8bc-f66a1fd02f34 with Priority: HIGHEST for action security_group_rules [ 729.874986] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7df896f-39aa-4236-b8bc-f66a1fd02f34 with Priority: HIGHEST for action security_group_rules [ 729.875391] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.875580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.875703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.875962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.876117] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7df896f-39aa-4236-b8bc-f66a1fd02f34',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.879398] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.879532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.879627] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.879792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.879928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.891437] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: IN_PROGRESS for 2s [ 729.931850] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.931996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.932116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.932378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.932578] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.932689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.932765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.934455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.934550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.934664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.934836] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.935344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.935449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.935619] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.935773] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.935875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.935939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.936223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.936328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.936419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.936532] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.405270] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.405563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.405563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.406358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.406358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.406358] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7df896f-39aa-4236-b8bc-f66a1fd02f34 already deleted. [ 730.406358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7df896f-39aa-4236-b8bc-f66a1fd02f34" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.441798] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc: rpc.has_security_group_logging(os_id): False [ 730.471521] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.471797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.471932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.472296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.472410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.472667] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.472769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.472831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.472998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.473087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.473272] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.473367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.473465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.477024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.477024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.477024] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.477024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.477024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.477024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.477024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.477024] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc is going to be updated. [ 730.503317] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad in Status: SUCCESS [ 730.503512] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad deletion is rescheduled due to dependency. [ 730.503640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.581404] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.581653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.581733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.581986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.582157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.609876] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: IN_PROGRESS for 2s [ 731.567817] env[66730]: INFO networking_nsxv3.common.synchronization [req-c5cfb9f8-0165-480e-a1c6-63530286615d req-ebfc777c-2c75-4f4b-baf4-7a47740c47ae tempest-ListServersNegativeTestJSON-1736181721 tempest-ListServersNegativeTestJSON-1736181721-project-member] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 731.568658] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 731.570031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.570031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.570031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.570031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.570339] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.573309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.573309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.573309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.573309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.573309] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.904340] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: SUCCESS [ 731.904529] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 deletion is rescheduled due to dependency. [ 731.904734] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.075585] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.361207] env[66730]: INFO networking_nsxv3.common.synchronization [req-13b179f0-da20-44fd-b4c8-40578dc54d4b req-eb1452f6-cbbb-4152-8667-0916eb42f805 tempest-ListServersNegativeTestJSON-1736181721 tempest-ListServersNegativeTestJSON-1736181721-project-member] Enqueued Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 732.361772] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 with Priority: HIGHEST for action security_group_members [ 732.362099] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.363801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.580105] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.627818] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: SUCCESS [ 732.628187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.085500] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.085500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.085500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.085500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.085500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.085500] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be updated. [ 733.148281] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.150894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.150894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.150894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.150894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.161620] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: IN_PROGRESS for 2s [ 733.451557] env[66730]: INFO networking_nsxv3.common.synchronization [req-95b4356f-4e1f-4c59-be48-b2dea3419184 req-078f0169-1f71-4e2c-8d9f-af27fdda1ec1 tempest-ServerActionsTestOtherB-1094684457 tempest-ServerActionsTestOtherB-1094684457-project-member] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 733.453091] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 733.453091] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.453091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.453091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.453091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.453387] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.454929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.454929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.454929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.454929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.454929] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.916399] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.916921] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.917022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.917915] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.918251] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.918422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.918560] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.918800] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.918936] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.919186] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.919310] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.919414] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.919517] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.919623] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.919722] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.919865] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.943949] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.944201] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.944365] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.944562] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.944971] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-3d8ce29d-3f73-4476-ace2-e55889d07b9f taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.945230] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-3d8ce29d-3f73-4476-ace2-e55889d07b9f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.945373] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-3d8ce29d-3f73-4476-ace2-e55889d07b9f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.945756] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-3d8ce29d-3f73-4476-ace2-e55889d07b9f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.945924] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d8ce29d-3f73-4476-ace2-e55889d07b9f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.956377] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.956560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.956654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.956915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.956996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.957273] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.957399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.957471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.957642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.957760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.957861] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba already deleted. [ 733.957940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.449369] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.449740] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.449958] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.450453] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.450706] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.450997] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 3d8ce29d-3f73-4476-ace2-e55889d07b9f not found, creating... [ 734.451492] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.451824] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.452061] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.452547] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.452861] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.453410] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.453663] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.453861] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.454228] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.454454] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.454737] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 3d8ce29d-3f73-4476-ace2-e55889d07b9f is going to be created. [ 734.479647] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.479870] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.480045] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.480275] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.480493] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.480755] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-3d8ce29d-3f73-4476-ace2-e55889d07b9f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.172944] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 735.173460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.173845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.173845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.174085] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.174210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.174261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.174474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.174604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.174906] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.202244] env[66730]: INFO networking_nsxv3.common.synchronization [req-95b4356f-4e1f-4c59-be48-b2dea3419184 req-8ddd691d-787a-4981-8c1b-876627b94aec service nova] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 735.202244] env[66730]: INFO networking_nsxv3.common.synchronization [req-95b4356f-4e1f-4c59-be48-b2dea3419184 req-8ddd691d-787a-4981-8c1b-876627b94aec service nova] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 735.202244] env[66730]: INFO networking_nsxv3.common.synchronization [req-95b4356f-4e1f-4c59-be48-b2dea3419184 req-8ddd691d-787a-4981-8c1b-876627b94aec service nova] Enqueued Resource ID: 3d8ce29d-3f73-4476-ace2-e55889d07b9f with Priority: HIGHEST for action port [ 735.202527] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 735.202877] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 735.202877] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8ce29d-3f73-4476-ace2-e55889d07b9f with Priority: HIGHEST for action port [ 735.203314] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.203435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.203498] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.203698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.203808] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.205085] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.205222] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.205323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.205454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.205601] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.205696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.205754] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.205894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.206070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.208926] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.211146] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d8ce29d-3f73-4476-ace2-e55889d07b9f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.211146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d8ce29d-3f73-4476-ace2-e55889d07b9f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.211146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d8ce29d-3f73-4476-ace2-e55889d07b9f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.211146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d8ce29d-3f73-4476-ace2-e55889d07b9f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.211146] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d8ce29d-3f73-4476-ace2-e55889d07b9f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.218209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.218361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.677192] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.678037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.678037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.678037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.678037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.678345] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.678433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.678483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.678800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.678800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.678800] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 is going to be updated. [ 735.708262] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.708262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.708262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.708262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.708262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.716727] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: IN_PROGRESS for 2s [ 735.720065] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.721327] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d8ce29d-3f73-4476-ace2-e55889d07b9f with status ACTIVE [ 735.721327] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.721327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.721327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.721327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.721327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.721327] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.721756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.721756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.721756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.721756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.722089] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.722089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.722089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.722253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.722253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.722349] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d8ce29d-3f73-4476-ace2-e55889d07b9f is going to be updated. [ 735.745074] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.745328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.745328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.748289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.748289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.748289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d8ce29d-3f73-4476-ace2-e55889d07b9f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.220711] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.723321] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.723928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.723928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.723928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.723928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.724177] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be created. [ 736.750313] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.750531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.750531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.750744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.750904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.788965] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: UNINITIALIZED for 2s [ 737.733577] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 in Status: SUCCESS [ 737.733577] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0 deletion is rescheduled due to dependency. [ 737.733861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.802027] env[66730]: INFO networking_nsxv3.common.synchronization [req-64e0c4cb-d6ef-4c5b-aa87-e3fa7b4a86b1 req-a2ddfee1-2f3d-4ccc-bc00-1994c5cdeb88 tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 738.803055] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 738.803280] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.803586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.803763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.805684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.805684] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.805684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.805684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.805684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.805684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.805684] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.807633] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 738.807945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.808280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.808807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.810027] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.810027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.810027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.810027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.810027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.810027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.810027] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.304186] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.304186] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-366" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.304186] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-366" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.304186] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-366" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.304480] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.304552] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.304896] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.304979] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.305061] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.305328] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.305429] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.305531] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.305755] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.305833] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.305913] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.306078] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.307588] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.307701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.307755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.307918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.309546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.309546] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.309546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.309546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.309546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.309546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.309546] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 already deleted. [ 739.309546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.312334] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.330250] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.330409] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.330546] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.330729] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-366" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.331058] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-e47ade27-9288-46b6-b736-eba93fe189a5 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.331227] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.331340] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.331699] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.331931] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47ade27-9288-46b6-b736-eba93fe189a5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.437965] env[66730]: INFO networking_nsxv3.common.synchronization [req-2c112f15-a58a-405d-a3a8-94c57c4609f9 req-a4ceb732-8ab2-4077-82cd-930c941e1589 tempest-ServersNegativeTestJSON-256798717 tempest-ServersNegativeTestJSON-256798717-project-member] Enqueued Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 739.439079] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 739.439478] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.439610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.439694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.439939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.440161] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.440283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.440362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.440626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.440717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.440811] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.815687] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a55c2a9-6077-4f76-8e80-8d941329a6ba: rpc.has_security_group_logging(os_id): False [ 739.835220] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.835681] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.835847] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.836248] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.836409] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.836657] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port e47ade27-9288-46b6-b736-eba93fe189a5 not found, creating... [ 739.837033] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.837290] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.837435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.837761] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.837918] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.838364] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.838529] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.838643] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.839035] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.839387] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.839455] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: e47ade27-9288-46b6-b736-eba93fe189a5 is going to be created. [ 739.845019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.845019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.845019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.845019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.845019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.845019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.845019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.845019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.845019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.845019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.845019] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be created. [ 739.866823] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.867021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.867147] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.867424] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.870052] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.870052] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.915076] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.915076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.915076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.915076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.915470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.933577] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 739.943175] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.446927] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.610492] env[66730]: INFO networking_nsxv3.common.synchronization [req-64e0c4cb-d6ef-4c5b-aa87-e3fa7b4a86b1 req-71031e4c-b9ef-46ea-920f-f2b11425fa01 service nova] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_rules [ 740.611978] env[66730]: INFO networking_nsxv3.common.synchronization [req-64e0c4cb-d6ef-4c5b-aa87-e3fa7b4a86b1 req-71031e4c-b9ef-46ea-920f-f2b11425fa01 service nova] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 740.612997] env[66730]: INFO networking_nsxv3.common.synchronization [req-64e0c4cb-d6ef-4c5b-aa87-e3fa7b4a86b1 req-71031e4c-b9ef-46ea-920f-f2b11425fa01 service nova] Enqueued Resource ID: e47ade27-9288-46b6-b736-eba93fe189a5 with Priority: HIGHEST for action port [ 740.614270] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_rules [ 740.614434] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 740.614533] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e47ade27-9288-46b6-b736-eba93fe189a5 with Priority: HIGHEST for action port [ 740.614846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.614967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.615044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.615319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.615441] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.621884] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.621884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.621884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.621884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.621884] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.621884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.621884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.621884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.621884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.621884] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.621884] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e47ade27-9288-46b6-b736-eba93fe189a5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.621884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.621884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.622416] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.622416] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47ade27-9288-46b6-b736-eba93fe189a5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.950082] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.950082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.950082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.950082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.950082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.950082] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc is going to be updated. [ 741.004038] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.004038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.004038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.004038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.004038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.017785] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: IN_PROGRESS for 2s [ 741.125102] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.129237] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.129497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.129797] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e47ade27-9288-46b6-b736-eba93fe189a5 with status ACTIVE [ 741.130380] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.130380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.130380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.130779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.130779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.131027] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.131112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.132685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.132685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.132685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.132685] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.132685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.132685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.132685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.132685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.132685] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e47ade27-9288-46b6-b736-eba93fe189a5 is going to be updated. [ 741.170542] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.170711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.170782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.170995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.171145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.171308] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.635945] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.948680] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 741.948915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.141191] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.141191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.141191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.141191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.141191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.141191] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 is going to be created. [ 742.163953] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.163953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.163953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.163953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.163953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.173197] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: UNINITIALIZED for 2s [ 743.065206] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: SUCCESS [ 743.065555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.379801] env[66730]: INFO networking_nsxv3.common.synchronization [req-e7b7c790-7286-4727-a51f-191423953206 req-9d11d7cb-08a6-478e-b5b0-fbd2370c807f tempest-ServerMetadataTestJSON-347358542 tempest-ServerMetadataTestJSON-347358542-project-member] Enqueued Resource ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 with Priority: HIGHEST for action security_group_members [ 743.380685] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 with Priority: HIGHEST for action security_group_members [ 743.381508] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe5a304a-21dc-43a8-b167-e76adbb7bc66 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.381775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.381870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.382281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.382548] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.383471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.383598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.383915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.384148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.384342] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe5a304a-21dc-43a8-b167-e76adbb7bc66',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.887949] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.887949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.887949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.887949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.888271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.892020] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.892020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.892020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.892020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.892020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.892020] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 already deleted. [ 743.892020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.892485] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-278 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.892731] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-278" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.892847] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-278" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.893084] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-278" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.893332] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.893473] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.893580] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.893783] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.893910] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.894805] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.895039] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.895185] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.895325] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.895483] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.895551] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.895741] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.916994] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.917286] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 743.917487] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.917717] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-278" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.918101] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-976ef87a-73c6-446c-8b0e-d99e6802d975 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.918395] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-976ef87a-73c6-446c-8b0e-d99e6802d975" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.918556] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-976ef87a-73c6-446c-8b0e-d99e6802d975" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.918920] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-976ef87a-73c6-446c-8b0e-d99e6802d975" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.919123] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('976ef87a-73c6-446c-8b0e-d99e6802d975',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.186493] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: SUCCESS [ 744.186667] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.186906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.187091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.187313] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.187433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.187557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.187681] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.188217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.188217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.188217] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.421572] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.421998] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.421998] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.422179] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.422326] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.422476] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 976ef87a-73c6-446c-8b0e-d99e6802d975 not found, creating... [ 744.422729] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.422952] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.423101] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.423327] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.423497] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.423763] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.423929] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.424088] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.424435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.424435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.424578] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 976ef87a-73c6-446c-8b0e-d99e6802d975 is going to be created. [ 744.450632] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.450839] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.450974] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.451315] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.451562] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.451875] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-976ef87a-73c6-446c-8b0e-d99e6802d975" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.691343] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.142739] env[66730]: INFO networking_nsxv3.common.synchronization [req-e7b7c790-7286-4727-a51f-191423953206 req-10c34669-d4c7-4e1d-9b62-06b2467dcd48 service nova] Enqueued Resource ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 with Priority: HIGHEST for action security_group_rules [ 745.142915] env[66730]: INFO networking_nsxv3.common.synchronization [req-e7b7c790-7286-4727-a51f-191423953206 req-10c34669-d4c7-4e1d-9b62-06b2467dcd48 service nova] Enqueued Resource ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 with Priority: HIGHEST for action security_group_members [ 745.143060] env[66730]: INFO networking_nsxv3.common.synchronization [req-e7b7c790-7286-4727-a51f-191423953206 req-10c34669-d4c7-4e1d-9b62-06b2467dcd48 service nova] Enqueued Resource ID: 976ef87a-73c6-446c-8b0e-d99e6802d975 with Priority: HIGHEST for action port [ 745.143599] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 with Priority: HIGHEST for action security_group_rules [ 745.143730] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 with Priority: HIGHEST for action security_group_members [ 745.143846] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 976ef87a-73c6-446c-8b0e-d99e6802d975 with Priority: HIGHEST for action port [ 745.144106] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe5a304a-21dc-43a8-b167-e76adbb7bc66 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.144246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.144286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.144582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.144672] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe5a304a-21dc-43a8-b167-e76adbb7bc66',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.145491] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe5a304a-21dc-43a8-b167-e76adbb7bc66 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.145640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.145700] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.145871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.146079] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.146162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.146225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.146355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.146447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.146535] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe5a304a-21dc-43a8-b167-e76adbb7bc66',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.147271] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-976ef87a-73c6-446c-8b0e-d99e6802d975 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.147382] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-976ef87a-73c6-446c-8b0e-d99e6802d975" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.147667] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-976ef87a-73c6-446c-8b0e-d99e6802d975" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.147667] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-976ef87a-73c6-446c-8b0e-d99e6802d975" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.147667] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('976ef87a-73c6-446c-8b0e-d99e6802d975',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.194508] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4547e193-954e-4aa0-b017-08b4a3a04519: rpc.has_security_group_logging(os_id): False [ 745.212888] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.213135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.213135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.213360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.213483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.213847] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.213990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.214090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.214296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.214402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.214512] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 is going to be created. [ 745.282195] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.282346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.282404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.282617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.282789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.296531] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: IN_PROGRESS for 2s [ 745.649222] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe5a304a-21dc-43a8-b167-e76adbb7bc66 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.649651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.651786] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe5a304a-21dc-43a8-b167-e76adbb7bc66',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.652724] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 976ef87a-73c6-446c-8b0e-d99e6802d975 with status ACTIVE [ 745.653484] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.653484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.653484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.653484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.653484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.653755] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.653810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.653861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.653995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.654100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.654282] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.654393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.654463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.654621] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.654709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.654794] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 976ef87a-73c6-446c-8b0e-d99e6802d975 is going to be updated. [ 745.681273] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.681273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.681273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.681445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.681581] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.681744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-976ef87a-73c6-446c-8b0e-d99e6802d975" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.123227] env[66730]: INFO networking_nsxv3.common.synchronization [None req-934da3c3-e5d8-4121-98a7-06d70f942e02 None None] Enqueued Resource ID: 92587548-79d9-4c2e-b37f-bbcb4aa93da6 with Priority: HIGHEST for action port [ 746.124015] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92587548-79d9-4c2e-b37f-bbcb4aa93da6 with Priority: HIGHEST for action port [ 746.124365] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-92587548-79d9-4c2e-b37f-bbcb4aa93da6 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.124682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92587548-79d9-4c2e-b37f-bbcb4aa93da6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.124815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92587548-79d9-4c2e-b37f-bbcb4aa93da6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.125104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92587548-79d9-4c2e-b37f-bbcb4aa93da6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.125232] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92587548-79d9-4c2e-b37f-bbcb4aa93da6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.158272] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe5a304a-21dc-43a8-b167-e76adbb7bc66',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.627946] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92587548-79d9-4c2e-b37f-bbcb4aa93da6 [ 746.628823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.628823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.628823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.630034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.630034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.630034] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92587548-79d9-4c2e-b37f-bbcb4aa93da6 already deleted. [ 746.630034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92587548-79d9-4c2e-b37f-bbcb4aa93da6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.659890] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.660203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.660203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.660352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.660432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.660605] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 is going to be created. [ 746.692653] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.692825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.692936] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.693126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.693284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.710025] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 in Status: UNINITIALIZED for 2s [ 746.721807] env[66730]: INFO networking_nsxv3.common.synchronization [req-23612124-cc18-4273-a01e-c24e035fced9 req-7bf7571d-d8ba-4109-8492-35dcf23c343f tempest-MigrationsAdminTest-1802784989 tempest-MigrationsAdminTest-1802784989-project-member] Enqueued Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 746.725330] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 746.726173] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.726358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.726431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.726654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.726814] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.726911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.726971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.727129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.727214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.727334] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.783627] env[66730]: INFO networking_nsxv3.common.synchronization [None req-556618d2-4a1a-4cc0-8be6-c0c1b074aa93 None None] Enqueued Resource ID: 0c492365-adbd-4519-8686-db687d7cf356 with Priority: HIGHEST for action port [ 746.785919] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c492365-adbd-4519-8686-db687d7cf356 with Priority: HIGHEST for action port [ 746.785919] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c492365-adbd-4519-8686-db687d7cf356 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.785919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c492365-adbd-4519-8686-db687d7cf356" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.785919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c492365-adbd-4519-8686-db687d7cf356" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.788013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c492365-adbd-4519-8686-db687d7cf356" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.788013] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c492365-adbd-4519-8686-db687d7cf356',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.230575] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.285898] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.286189] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.286332] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.286695] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.286989] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.287245] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.287391] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.287640] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.287817] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.288072] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.288229] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.288359] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.288486] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.288618] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.288745] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.288964] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.290418] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c492365-adbd-4519-8686-db687d7cf356 [ 747.290654] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.291029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.291137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.291343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.292094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.292202] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c492365-adbd-4519-8686-db687d7cf356 already deleted. [ 747.292336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c492365-adbd-4519-8686-db687d7cf356" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.309226] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: SUCCESS [ 747.309561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.312982] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.313169] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 747.313302] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.313563] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.313794] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-0e85c019-7cb3-420d-9d5d-35ea008e6abe taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.313973] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-0e85c019-7cb3-420d-9d5d-35ea008e6abe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.314194] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-0e85c019-7cb3-420d-9d5d-35ea008e6abe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.318238] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-0e85c019-7cb3-420d-9d5d-35ea008e6abe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.318426] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e85c019-7cb3-420d-9d5d-35ea008e6abe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.737857] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.822025] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.822025] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.822551] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.822551] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.822551] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.822695] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 0e85c019-7cb3-420d-9d5d-35ea008e6abe not found, creating... [ 747.823346] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.823346] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.823346] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.823524] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.823524] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.824158] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.824158] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.824158] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.824306] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.825472] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.825472] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 0e85c019-7cb3-420d-9d5d-35ea008e6abe is going to be created. [ 747.849056] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.849267] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.849385] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.850363] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.850363] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.850363] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-0e85c019-7cb3-420d-9d5d-35ea008e6abe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.240919] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.241130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.241176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.242315] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.242315] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.242315] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 is going to be updated. [ 748.276049] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.276237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.276805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.277038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.277188] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.288019] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: IN_PROGRESS for 2s [ 748.580870] env[66730]: INFO networking_nsxv3.common.synchronization [req-23612124-cc18-4273-a01e-c24e035fced9 req-7a9e2b50-05d0-477b-9b6d-20c00353456c service nova] Enqueued Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_rules [ 748.580870] env[66730]: INFO networking_nsxv3.common.synchronization [req-23612124-cc18-4273-a01e-c24e035fced9 req-7a9e2b50-05d0-477b-9b6d-20c00353456c service nova] Enqueued Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 748.580870] env[66730]: INFO networking_nsxv3.common.synchronization [req-23612124-cc18-4273-a01e-c24e035fced9 req-7a9e2b50-05d0-477b-9b6d-20c00353456c service nova] Enqueued Resource ID: 0e85c019-7cb3-420d-9d5d-35ea008e6abe with Priority: HIGHEST for action port [ 748.581289] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_rules [ 748.581400] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 748.581444] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e85c019-7cb3-420d-9d5d-35ea008e6abe with Priority: HIGHEST for action port [ 748.582752] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.582752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.582752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.582752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.582752] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.583755] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.583986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.584086] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e85c019-7cb3-420d-9d5d-35ea008e6abe taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.585036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e85c019-7cb3-420d-9d5d-35ea008e6abe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.585036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e85c019-7cb3-420d-9d5d-35ea008e6abe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.585036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e85c019-7cb3-420d-9d5d-35ea008e6abe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.585036] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e85c019-7cb3-420d-9d5d-35ea008e6abe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.718456] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 in Status: SUCCESS [ 748.718893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.719653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.720098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.720474] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.720752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.720752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.720992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.721133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.721258] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.721386] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe5a304a-21dc-43a8-b167-e76adbb7bc66',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.977608] env[66730]: INFO networking_nsxv3.common.synchronization [req-711ba75c-9fc6-43d5-bc4d-9bfa29926732 req-15e10abd-300b-4344-9b43-c17ecba36ba0 tempest-ServersAdminTestJSON-1056025790 tempest-ServersAdminTestJSON-1056025790-project-member] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 748.977608] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 748.978378] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.978562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.978562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.978776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.982022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.982022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.982022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.982022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.982022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.982022] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.022640] env[66730]: INFO networking_nsxv3.common.synchronization [None req-483e2a0a-ed5d-4959-b633-f30caf33575c None None] Enqueued Resource ID: 9ad0d180-c712-4d4a-b69c-94cbacdb7066 with Priority: HIGHEST for action port [ 749.024946] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ad0d180-c712-4d4a-b69c-94cbacdb7066 with Priority: HIGHEST for action port [ 749.025317] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ad0d180-c712-4d4a-b69c-94cbacdb7066 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.025447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ad0d180-c712-4d4a-b69c-94cbacdb7066" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.025517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ad0d180-c712-4d4a-b69c-94cbacdb7066" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.025794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ad0d180-c712-4d4a-b69c-94cbacdb7066" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.025877] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ad0d180-c712-4d4a-b69c-94cbacdb7066',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.088037] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.088037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.088037] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e85c019-7cb3-420d-9d5d-35ea008e6abe with status ACTIVE [ 749.088037] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.088037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.088037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.088037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.088037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.088748] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.088910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.088938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.089208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.089330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.090493] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.091802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.091949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.092286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.092345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.092474] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e85c019-7cb3-420d-9d5d-35ea008e6abe is going to be updated. [ 749.120042] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.120197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.120272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.120489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.120647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.120811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e85c019-7cb3-420d-9d5d-35ea008e6abe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.225042] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe5a304a-21dc-43a8-b167-e76adbb7bc66 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.225042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.225042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.225042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.225042] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.225042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.225042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.225042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.225042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.225603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.225603] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe5a304a-21dc-43a8-b167-e76adbb7bc66 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.225603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.225603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.225722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.225828] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.225926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.226016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.226228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.226357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.226419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.228456] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe5a304a-21dc-43a8-b167-e76adbb7bc66',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.406745] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.406958] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.407080] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.407599] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.407872] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.408040] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.408153] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.408441] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.408579] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.408781] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.408885] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.408989] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.409103] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.409205] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.409322] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.409458] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.428890] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.429063] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 749.429201] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.429407] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.429736] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-15a76a89-5ba8-4833-bea2-fe27664eb046 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.429905] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-15a76a89-5ba8-4833-bea2-fe27664eb046" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.430026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-15a76a89-5ba8-4833-bea2-fe27664eb046" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.430371] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-15a76a89-5ba8-4833-bea2-fe27664eb046" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.430539] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15a76a89-5ba8-4833-bea2-fe27664eb046',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.484889] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.506206] env[66730]: INFO networking_nsxv3.common.synchronization [None req-adc7605f-573a-40ea-94fb-c62c531ee3f4 None None] Enqueued Resource ID: 647a79da-4d3c-44ad-9cf4-85472e9f18f1 with Priority: HIGHEST for action port [ 749.506483] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647a79da-4d3c-44ad-9cf4-85472e9f18f1 with Priority: HIGHEST for action port [ 749.507120] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-647a79da-4d3c-44ad-9cf4-85472e9f18f1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.507275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-647a79da-4d3c-44ad-9cf4-85472e9f18f1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.507346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-647a79da-4d3c-44ad-9cf4-85472e9f18f1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.507597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-647a79da-4d3c-44ad-9cf4-85472e9f18f1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.507866] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('647a79da-4d3c-44ad-9cf4-85472e9f18f1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.530341] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ad0d180-c712-4d4a-b69c-94cbacdb7066 [ 749.530580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.530706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.530776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.530993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.531168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.531215] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ad0d180-c712-4d4a-b69c-94cbacdb7066 already deleted. [ 749.531301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ad0d180-c712-4d4a-b69c-94cbacdb7066" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.732752] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe5a304a-21dc-43a8-b167-e76adbb7bc66: rpc.has_security_group_logging(os_id): False [ 749.752209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.752209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.752209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.752209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.752849] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.752849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.752849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.752849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.752849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.752849] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 is going to be created. [ 749.824485] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.824660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.824741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.826702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.826921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.843197] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 in Status: IN_PROGRESS for 2s [ 749.933728] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.935456] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.935456] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.935456] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.935456] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.935456] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 15a76a89-5ba8-4833-bea2-fe27664eb046 not found, creating... [ 749.935722] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.935722] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.935857] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.936158] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.936459] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.936745] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.936968] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.937132] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.937481] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.937660] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.938468] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 15a76a89-5ba8-4833-bea2-fe27664eb046 is going to be created. [ 749.962295] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.962533] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.962611] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.962882] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.963156] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.963376] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-15a76a89-5ba8-4833-bea2-fe27664eb046" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.986904] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.011678] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 647a79da-4d3c-44ad-9cf4-85472e9f18f1 [ 750.012270] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.012270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.012270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.012436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.012436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.012625] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:647a79da-4d3c-44ad-9cf4-85472e9f18f1 already deleted. [ 750.012625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-647a79da-4d3c-44ad-9cf4-85472e9f18f1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.013529] env[66730]: INFO networking_nsxv3.common.synchronization [None req-bab35f3c-9a3b-494d-a245-015478ef11dc tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_rules [ 750.014385] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_rules [ 750.014482] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.014597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.014662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.014884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.014969] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.146710] env[66730]: INFO networking_nsxv3.common.synchronization [None req-8d363591-f72f-42b6-97d7-b2d78e2a7520 tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_rules [ 750.147064] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_rules [ 750.147376] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.147461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.304674] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: SUCCESS [ 750.308216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.308216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.308216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.308216] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.308216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.308216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.308216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.308216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.308216] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.490369] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.490580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.490647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.490829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.490919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.491032] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 750.521409] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.521409] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.521720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.521720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.521921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.532904] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 750.539032] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.539397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.539588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.539685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.539767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.539995] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 already deleted. [ 750.539995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.540172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.540352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.540352] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.722377] env[66730]: INFO networking_nsxv3.common.synchronization [req-711ba75c-9fc6-43d5-bc4d-9bfa29926732 req-9d693d14-5bd9-4c18-a7a9-99eb9197af71 service nova] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_rules [ 750.722752] env[66730]: INFO networking_nsxv3.common.synchronization [req-711ba75c-9fc6-43d5-bc4d-9bfa29926732 req-9d693d14-5bd9-4c18-a7a9-99eb9197af71 service nova] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 750.723175] env[66730]: INFO networking_nsxv3.common.synchronization [req-711ba75c-9fc6-43d5-bc4d-9bfa29926732 req-9d693d14-5bd9-4c18-a7a9-99eb9197af71 service nova] Enqueued Resource ID: 15a76a89-5ba8-4833-bea2-fe27664eb046 with Priority: HIGHEST for action port [ 750.723831] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_rules [ 750.724034] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 750.724191] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a76a89-5ba8-4833-bea2-fe27664eb046 with Priority: HIGHEST for action port [ 750.724714] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.724848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.725010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.725227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.725310] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.726199] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.726301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.726495] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-15a76a89-5ba8-4833-bea2-fe27664eb046 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.726589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15a76a89-5ba8-4833-bea2-fe27664eb046" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.726651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15a76a89-5ba8-4833-bea2-fe27664eb046" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.726830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15a76a89-5ba8-4833-bea2-fe27664eb046" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.726906] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15a76a89-5ba8-4833-bea2-fe27664eb046',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.812275] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.068580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.069074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.069074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.069074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.069170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.069213] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 already deleted. [ 751.069277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.233272] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.233422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.233615] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15a76a89-5ba8-4833-bea2-fe27664eb046 with status ACTIVE [ 751.233785] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.233892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.233956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.234192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.234303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.234485] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.234601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.234665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.234925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.234925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.235142] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.235265] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.235348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.235530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.235611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.235711] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15a76a89-5ba8-4833-bea2-fe27664eb046 is going to be updated. [ 751.273725] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.273873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.273944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.274175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.274321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.274479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15a76a89-5ba8-4833-bea2-fe27664eb046" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.315074] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.765542] env[66730]: INFO networking_nsxv3.common.synchronization [req-23291d1f-2144-4174-9c3e-22624cce16c8 req-1657bfd6-d14b-4930-b9c7-e3548ab71ed6 tempest-ServerTagsTestJSON-528081549 tempest-ServerTagsTestJSON-528081549-project-member] Enqueued Resource ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 with Priority: HIGHEST for action security_group_members [ 751.766106] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 with Priority: HIGHEST for action security_group_members [ 751.766926] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.766926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.766926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.766926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.769033] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.769196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.769266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.769450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.769539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.769649] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94ea1b6a-f403-40f1-b3c2-7f52a8429c38',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.817064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.817244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.817321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.817592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.817628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.817705] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 is going to be updated. [ 751.848564] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.848759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.848833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.849091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.849240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.858040] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 in Status: SUCCESS [ 751.858572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.866312] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: IN_PROGRESS for 2s [ 752.127278] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-132 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.127278] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-132" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.127278] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-132" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.127278] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-132" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.127278] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.127278] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.127278] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.127278] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.127278] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.128043] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.128043] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.128287] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.128287] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.128395] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.128487] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.128617] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.146491] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.146707] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 752.146924] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.147149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-132" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.147483] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-b4ca1dff-332c-4026-aaf9-8851df166799 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.147684] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-b4ca1dff-332c-4026-aaf9-8851df166799" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.147821] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-b4ca1dff-332c-4026-aaf9-8851df166799" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.148172] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-b4ca1dff-332c-4026-aaf9-8851df166799" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.148429] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4ca1dff-332c-4026-aaf9-8851df166799',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.272399] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.272586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.272626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.272843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.273046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.273147] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.273240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.273293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.273460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.273677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.273779] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 already deleted. [ 752.273862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.544861] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 752.545660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.545875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.546176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.546371] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.546493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.546582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.546723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.546813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.546992] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.652310] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.652600] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.652683] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.652958] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.653108] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.653257] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port b4ca1dff-332c-4026-aaf9-8851df166799 not found, creating... [ 752.653694] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.653857] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.653966] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.654415] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.654554] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.654839] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.654987] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.655120] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.655309] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.655424] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.655556] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: b4ca1dff-332c-4026-aaf9-8851df166799 is going to be created. [ 752.678699] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.679527] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.679527] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.679527] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.679856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.679988] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-b4ca1dff-332c-4026-aaf9-8851df166799" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.049547] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.476965] env[66730]: INFO networking_nsxv3.common.synchronization [req-23291d1f-2144-4174-9c3e-22624cce16c8 req-28bfb15e-de66-40b7-89ab-d9a3d73233f1 service nova] Enqueued Resource ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 with Priority: HIGHEST for action security_group_rules [ 753.476965] env[66730]: INFO networking_nsxv3.common.synchronization [req-23291d1f-2144-4174-9c3e-22624cce16c8 req-28bfb15e-de66-40b7-89ab-d9a3d73233f1 service nova] Enqueued Resource ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 with Priority: HIGHEST for action security_group_members [ 753.476965] env[66730]: INFO networking_nsxv3.common.synchronization [req-23291d1f-2144-4174-9c3e-22624cce16c8 req-28bfb15e-de66-40b7-89ab-d9a3d73233f1 service nova] Enqueued Resource ID: b4ca1dff-332c-4026-aaf9-8851df166799 with Priority: HIGHEST for action port [ 753.476965] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 with Priority: HIGHEST for action security_group_rules [ 753.476965] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 with Priority: HIGHEST for action security_group_members [ 753.476965] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ca1dff-332c-4026-aaf9-8851df166799 with Priority: HIGHEST for action port [ 753.478137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94ea1b6a-f403-40f1-b3c2-7f52a8429c38 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.478803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.483325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.483325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.483325] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94ea1b6a-f403-40f1-b3c2-7f52a8429c38',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.483325] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.483325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.483325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.483325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.483325] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.483325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.483325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.483325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.483325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.483325] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94ea1b6a-f403-40f1-b3c2-7f52a8429c38',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.483325] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4ca1dff-332c-4026-aaf9-8851df166799 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.485723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4ca1dff-332c-4026-aaf9-8851df166799" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.485980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4ca1dff-332c-4026-aaf9-8851df166799" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.486311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4ca1dff-332c-4026-aaf9-8851df166799" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.486489] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4ca1dff-332c-4026-aaf9-8851df166799',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.555446] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.879896] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: SUCCESS [ 753.881067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.881288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.883012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.883012] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.883012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.883012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.883012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.883012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.883012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.883012] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.993469] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94ea1b6a-f403-40f1-b3c2-7f52a8429c38',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.993469] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.993469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.993469] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4ca1dff-332c-4026-aaf9-8851df166799 with status ACTIVE [ 753.993469] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.993771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.993771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.993835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.993899] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.995505] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.995505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.995505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.995505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.995505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.996164] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.996295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.996377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.996756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.996834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.997064] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4ca1dff-332c-4026-aaf9-8851df166799 is going to be updated. [ 754.027726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.027726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.028648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.028648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.028648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.028648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4ca1dff-332c-4026-aaf9-8851df166799" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.067202] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.067202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.067202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.067202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.067202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.067202] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 754.070644] env[66730]: INFO networking_nsxv3.common.synchronization [req-e0ccf8c4-21c4-4ffc-a630-39bbea8c3e37 req-16daa052-fbbd-4a91-abd4-7256784434a0 tempest-ImagesOneServerNegativeTestJSON-160835856 tempest-ImagesOneServerNegativeTestJSON-160835856-project-member] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 754.071738] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 754.072782] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.073148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.073418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.073761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.074065] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.075659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.075659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.075659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.075659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.075659] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.126841] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.127468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.127468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.127468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.127468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.141211] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 754.391041] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.391041] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.391041] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.391041] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.391041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.391795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.391795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.391795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.391795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.391795] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.500741] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94ea1b6a-f403-40f1-b3c2-7f52a8429c38',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.579687] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.580740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.584024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.584024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.584024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.584024] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.584024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.584024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.584024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.584024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.584024] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be updated. [ 754.627097] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.627097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.627097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.627097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.627097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.638936] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: IN_PROGRESS for 2s [ 754.895730] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dd73e9d-f53e-4682-9229-6fa30e9d8043: rpc.has_security_group_logging(os_id): False [ 754.922284] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.923702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.923782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.923990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.924090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.924290] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.926092] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.926092] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.926092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.926092] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 is going to be updated. [ 754.996323] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.996514] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.996621] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.996874] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.996972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.004524] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.004870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.005019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.005295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.005464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.005600] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 is going to be created. [ 755.012580] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: IN_PROGRESS for 2s [ 755.032293] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.032445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.032519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.032752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.032921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.050214] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 in Status: UNINITIALIZED for 2s [ 755.750607] env[66730]: INFO networking_nsxv3.common.synchronization [req-81254d28-d21e-45b0-8469-4cfb567faef9 req-5d962b0c-cfd6-4656-9392-44f7a65686b9 tempest-ImagesOneServerTestJSON-997968893 tempest-ImagesOneServerTestJSON-997968893-project-member] Enqueued Resource ID: a985d046-799d-4d0f-ae02-11071c04b015 with Priority: HIGHEST for action security_group_members [ 755.751142] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a985d046-799d-4d0f-ae02-11071c04b015 with Priority: HIGHEST for action security_group_members [ 755.751479] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a985d046-799d-4d0f-ae02-11071c04b015 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.751617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.751704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.751944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.752264] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.752375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.752438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.752598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.752684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.752838] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a985d046-799d-4d0f-ae02-11071c04b015',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.153277] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 756.153833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.154143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.154462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.154752] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.156020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.156020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.156020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.156020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.156020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.156020] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.257935] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.257935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.257935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.257935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.257935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.257935] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.257935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.257935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.257935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.257935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.257935] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a985d046-799d-4d0f-ae02-11071c04b015 is going to be updated. [ 756.297510] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.297510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.297510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.297510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.297510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.310253] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a985d046-799d-4d0f-ae02-11071c04b015 in Status: IN_PROGRESS for 2s [ 756.652897] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: SUCCESS [ 756.654194] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a deletion is rescheduled due to dependency. [ 756.654194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.658673] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.658933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.659097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.659467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.659716] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.659887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.659988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.660249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.660390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.660535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.660849] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.661195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.661262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.662361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.662736] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.663117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.663340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.665925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.665925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.665925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.665925] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.985046] env[66730]: INFO networking_nsxv3.common.synchronization [req-2aa9dbc8-2038-4ac8-90d6-64043fa84143 req-9660f690-863e-4d19-b1ed-573d06a73ea7 tempest-VolumesAssistedSnapshotsTest-130812955 tempest-VolumesAssistedSnapshotsTest-130812955-project-member] Enqueued Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_members [ 756.985647] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGHEST for action security_group_members [ 756.985977] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-93b3bb93-84fc-4123-b0bf-5f1575fd424b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.986132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.986209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.986463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.986644] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.986753] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.986829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.986987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.987919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.988048] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.031264] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: SUCCESS [ 757.031264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.059613] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 in Status: SUCCESS [ 757.059837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.060042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.060263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.060457] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.060651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.060729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.060897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.060980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.061109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.061221] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94ea1b6a-f403-40f1-b3c2-7f52a8429c38',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.169259] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4155358-3708-4cf2-b2a6-fe099ab35896: rpc.has_security_group_logging(os_id): False [ 757.191769] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.191769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.191769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.191769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.191769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.192177] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.192177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.192177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.192334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.192373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.192644] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.192768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.193633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.193633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.193633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.193633] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.193633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.193633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.193901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.193901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.194028] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 757.264831] env[66730]: INFO networking_nsxv3.common.synchronization [None req-56f719c5-b5dd-4692-b64b-9ec68d769e1a None None] Enqueued Resource ID: d42e8b0c-0105-44da-9c89-ebbd5fa1186f with Priority: HIGHEST for action port [ 757.265748] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d42e8b0c-0105-44da-9c89-ebbd5fa1186f with Priority: HIGHEST for action port [ 757.266117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d42e8b0c-0105-44da-9c89-ebbd5fa1186f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.266297] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d42e8b0c-0105-44da-9c89-ebbd5fa1186f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.266404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d42e8b0c-0105-44da-9c89-ebbd5fa1186f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.266684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d42e8b0c-0105-44da-9c89-ebbd5fa1186f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.266780] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d42e8b0c-0105-44da-9c89-ebbd5fa1186f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.273816] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.273967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.274060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.274314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.274546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.315124] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 757.495449] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.495449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.495449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.495449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.495449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.495449] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.495449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.495449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.495449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.495449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.502108] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b is going to be updated. [ 757.540278] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.540845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.540942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.541267] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.541461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.559785] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b in Status: IN_PROGRESS for 2s [ 757.563655] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.563906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.564054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.564403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.564670] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.564851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.564955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.565237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.565415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.565567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.565823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.565975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.568451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.568767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.569050] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.569214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.569323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.569570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.569709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.569852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.570008] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94ea1b6a-f403-40f1-b3c2-7f52a8429c38',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.769484] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d42e8b0c-0105-44da-9c89-ebbd5fa1186f [ 757.769723] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.769857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.769926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.770163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.770253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.770349] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d42e8b0c-0105-44da-9c89-ebbd5fa1186f already deleted. [ 757.770429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d42e8b0c-0105-44da-9c89-ebbd5fa1186f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.073377] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94ea1b6a-f403-40f1-b3c2-7f52a8429c38: rpc.has_security_group_logging(os_id): False [ 758.093523] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.093788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.093868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.095221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.095221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.095221] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.095221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.095221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.095221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.095221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.095221] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.095221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.095221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.095221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.095221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.095610] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.095610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.095610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.095702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.095729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.096326] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 is going to be created. [ 758.158066] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.158066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.158066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.158066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.158066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.174245] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 in Status: IN_PROGRESS for 2s [ 758.322143] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a985d046-799d-4d0f-ae02-11071c04b015 in Status: SUCCESS [ 758.322319] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a985d046-799d-4d0f-ae02-11071c04b015 deletion is rescheduled due to dependency. [ 758.322435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a985d046-799d-4d0f-ae02-11071c04b015" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.333405] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 759.334084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.569812] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b in Status: SUCCESS [ 759.570503] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b deletion is rescheduled due to dependency. [ 759.570503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.187924] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 in Status: SUCCESS [ 760.188163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.719863] env[66730]: INFO networking_nsxv3.common.synchronization [None req-c5fd915d-23c7-490a-b06a-882c52897f07 None None] Enqueued Resource ID: 9766c207-71c2-4ae3-9549-a3729e4c2b53 with Priority: HIGHEST for action port [ 760.720477] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9766c207-71c2-4ae3-9549-a3729e4c2b53 with Priority: HIGHEST for action port [ 760.720678] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9766c207-71c2-4ae3-9549-a3729e4c2b53 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.720815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9766c207-71c2-4ae3-9549-a3729e4c2b53" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.720867] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9766c207-71c2-4ae3-9549-a3729e4c2b53" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.721127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9766c207-71c2-4ae3-9549-a3729e4c2b53" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.721213] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9766c207-71c2-4ae3-9549-a3729e4c2b53',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.223220] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9766c207-71c2-4ae3-9549-a3729e4c2b53 [ 761.223487] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.223634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.223708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.223923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.224022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.224116] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9766c207-71c2-4ae3-9549-a3729e4c2b53 already deleted. [ 761.224200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9766c207-71c2-4ae3-9549-a3729e4c2b53" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.032466] env[66730]: INFO networking_nsxv3.common.synchronization [req-add5b2e2-7ecb-436a-8fe5-da52aef74295 req-c6aa2917-7493-43b2-949a-9029df5b75f0 tempest-ServersAdminNegativeTestJSON-140283744 tempest-ServersAdminNegativeTestJSON-140283744-project-member] Enqueued Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 762.033011] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 762.033335] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.033446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.033538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.033766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.033945] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.034082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.034171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.034359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.034452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.034562] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.324417] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.324640] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.324759] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.325065] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.325297] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.325448] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.325557] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.325761] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.325920] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.326418] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.326561] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.326668] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.326769] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.326871] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.326968] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.327128] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.348866] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.349037] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 762.349162] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.349347] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.349705] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-6254bac1-3938-4cb5-8db6-27a1c1c41e22 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.349891] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-6254bac1-3938-4cb5-8db6-27a1c1c41e22" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.350052] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-6254bac1-3938-4cb5-8db6-27a1c1c41e22" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.350517] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-6254bac1-3938-4cb5-8db6-27a1c1c41e22" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.350724] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6254bac1-3938-4cb5-8db6-27a1c1c41e22',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.536701] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.663084] env[66730]: INFO networking_nsxv3.common.synchronization [req-92ea1ea1-33cf-4972-8dca-9626d4c9ae55 req-c33b62ba-5c7b-460c-a4e3-65f749350f33 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 762.663084] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 762.663298] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.663415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.663473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.663762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.663906] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.663987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.664048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.664187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.664288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.664383] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.854180] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.854703] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.854703] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.854783] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.855117] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.855661] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 6254bac1-3938-4cb5-8db6-27a1c1c41e22 not found, creating... [ 762.855661] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.855661] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.855850] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.856012] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.856266] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.857069] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.857069] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.857069] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.857069] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.857069] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.857340] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 6254bac1-3938-4cb5-8db6-27a1c1c41e22 is going to be created. [ 762.878025] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.878261] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.878486] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.878733] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.878970] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.879194] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-6254bac1-3938-4cb5-8db6-27a1c1c41e22" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.992610] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.992817] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.992929] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.993223] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.993501] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.993664] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.993723] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.993923] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.994074] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.994277] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.994386] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.994492] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.994591] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.994758] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.994804] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.994904] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.022101] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.022101] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.022101] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.022480] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.022945] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-a35a370c-27fc-4ca5-b1af-807c7d3a0b6b taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.023250] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-a35a370c-27fc-4ca5-b1af-807c7d3a0b6b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.023468] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-a35a370c-27fc-4ca5-b1af-807c7d3a0b6b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.023953] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-a35a370c-27fc-4ca5-b1af-807c7d3a0b6b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.024210] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a35a370c-27fc-4ca5-b1af-807c7d3a0b6b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.039065] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.166870] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.167092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.167182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.167452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.167563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.167935] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.167935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.168038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.168142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.168219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.168353] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f already deleted. [ 763.168459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.527420] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.527666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.527728] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.528010] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.528174] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.528378] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port a35a370c-27fc-4ca5-b1af-807c7d3a0b6b not found, creating... [ 763.528778] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.528883] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.528918] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.529141] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.529282] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.529664] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.529774] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.530805] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.530805] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.530805] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.530805] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: a35a370c-27fc-4ca5-b1af-807c7d3a0b6b is going to be created. [ 763.541370] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.541543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.541543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.541717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.541789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.541890] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d is going to be updated. [ 763.556098] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.556415] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.556554] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.556863] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.557139] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.557376] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-a35a370c-27fc-4ca5-b1af-807c7d3a0b6b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.574605] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.574859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.574859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.575149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.575333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.585861] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: IN_PROGRESS for 2s [ 763.617629] env[66730]: INFO networking_nsxv3.common.synchronization [req-add5b2e2-7ecb-436a-8fe5-da52aef74295 req-2bf4a057-e424-48d5-a03c-a03ff10ee3b1 service nova] Enqueued Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_rules [ 763.617840] env[66730]: INFO networking_nsxv3.common.synchronization [req-add5b2e2-7ecb-436a-8fe5-da52aef74295 req-2bf4a057-e424-48d5-a03c-a03ff10ee3b1 service nova] Enqueued Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 763.617946] env[66730]: INFO networking_nsxv3.common.synchronization [req-add5b2e2-7ecb-436a-8fe5-da52aef74295 req-2bf4a057-e424-48d5-a03c-a03ff10ee3b1 service nova] Enqueued Resource ID: 6254bac1-3938-4cb5-8db6-27a1c1c41e22 with Priority: HIGHEST for action port [ 763.618603] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_rules [ 763.618734] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 763.618842] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6254bac1-3938-4cb5-8db6-27a1c1c41e22 with Priority: HIGHEST for action port [ 763.619147] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.619427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.619427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.619561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.619646] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.620558] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.620660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.620952] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-6254bac1-3938-4cb5-8db6-27a1c1c41e22 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.621050] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6254bac1-3938-4cb5-8db6-27a1c1c41e22" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.621104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6254bac1-3938-4cb5-8db6-27a1c1c41e22" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.621246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6254bac1-3938-4cb5-8db6-27a1c1c41e22" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.621322] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6254bac1-3938-4cb5-8db6-27a1c1c41e22',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.123125] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.123425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.123464] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6254bac1-3938-4cb5-8db6-27a1c1c41e22 with status ACTIVE [ 764.123637] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.123744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.123809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.124041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.124136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.124308] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.124403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.124464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.124615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.124689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.124866] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.124956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.125025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.125166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.125238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.125325] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6254bac1-3938-4cb5-8db6-27a1c1c41e22 is going to be updated. [ 764.150189] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.150326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.150444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.150669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.150849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.151050] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6254bac1-3938-4cb5-8db6-27a1c1c41e22" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.311087] env[66730]: INFO networking_nsxv3.common.synchronization [req-92ea1ea1-33cf-4972-8dca-9626d4c9ae55 req-2b246041-4a7f-43aa-925e-b84ea0c36301 service nova] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_rules [ 764.311159] env[66730]: INFO networking_nsxv3.common.synchronization [req-92ea1ea1-33cf-4972-8dca-9626d4c9ae55 req-2b246041-4a7f-43aa-925e-b84ea0c36301 service nova] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 764.311290] env[66730]: INFO networking_nsxv3.common.synchronization [req-92ea1ea1-33cf-4972-8dca-9626d4c9ae55 req-2b246041-4a7f-43aa-925e-b84ea0c36301 service nova] Enqueued Resource ID: a35a370c-27fc-4ca5-b1af-807c7d3a0b6b with Priority: HIGHEST for action port [ 764.311810] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_rules [ 764.311949] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 764.313441] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a35a370c-27fc-4ca5-b1af-807c7d3a0b6b with Priority: HIGHEST for action port [ 764.313532] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.313697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.313901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.314204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.314337] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.315360] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.315531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.315636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.315861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.316239] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.317267] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.317340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.317711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.317711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.317711] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.319058] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-a35a370c-27fc-4ca5-b1af-807c7d3a0b6b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.319058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a35a370c-27fc-4ca5-b1af-807c7d3a0b6b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.319058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a35a370c-27fc-4ca5-b1af-807c7d3a0b6b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.319253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a35a370c-27fc-4ca5-b1af-807c7d3a0b6b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.319361] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a35a370c-27fc-4ca5-b1af-807c7d3a0b6b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.822291] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.822477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.822741] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.823886] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a35a370c-27fc-4ca5-b1af-807c7d3a0b6b with status ACTIVE [ 764.824203] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.824294] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.824383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.824667] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.824768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.824950] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.825065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.825127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.825283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.825361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.825758] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.825758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.825758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.825892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.825892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.826220] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a35a370c-27fc-4ca5-b1af-807c7d3a0b6b is going to be updated. [ 764.849763] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.849928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.849996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.850320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.850483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.850695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a35a370c-27fc-4ca5-b1af-807c7d3a0b6b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.328490] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.598172] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: SUCCESS [ 765.598448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.598616] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.598865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.599013] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.599155] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.599227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.599420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.599506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.599599] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.831295] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.831415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.831465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.831677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.831759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.831853] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be created. [ 765.861751] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.861901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.861978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.862217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.862403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.873377] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: UNINITIALIZED for 2s [ 766.102109] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.603781] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.742289] env[66730]: INFO networking_nsxv3.common.synchronization [req-13112872-7178-44dd-acb3-71232de00c95 req-cc39cf65-ce8f-4db5-80fe-c5e251c05381 tempest-ServersWithSpecificFlavorTestJSON-740738296 tempest-ServersWithSpecificFlavorTestJSON-740738296-project-member] Enqueued Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 766.747010] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 766.747010] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.747010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.747010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.747010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.747010] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.747010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.747010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.747010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.747010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.747010] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.111426] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.111673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.111777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.112079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.112182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.112286] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d is going to be updated. [ 767.147768] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.147986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.147986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.148283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.148420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.158129] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-236 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.158607] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-236" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.158607] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-236" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.158797] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-236" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.159089] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.159251] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.159362] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.159580] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.159712] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.159911] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.160025] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.160127] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.160239] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.160334] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.160412] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.160536] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.162900] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: IN_PROGRESS for 2s [ 767.185096] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.185348] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.185612] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.185851] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-236" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.186278] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-9b678728-48f0-431c-9b2d-0e8b70e7b780 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.186478] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-9b678728-48f0-431c-9b2d-0e8b70e7b780" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.186630] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-9b678728-48f0-431c-9b2d-0e8b70e7b780" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.187063] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-9b678728-48f0-431c-9b2d-0e8b70e7b780" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.187239] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b678728-48f0-431c-9b2d-0e8b70e7b780',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.248596] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.248778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.248853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.249129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.249230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.249530] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.249635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.249701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.249861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.249943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.250046] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 is going to be updated. [ 767.286915] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.287030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.287192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.287498] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.287645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.300622] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: IN_PROGRESS for 2s [ 767.494522] env[66730]: INFO networking_nsxv3.common.synchronization [req-8e6c11d6-3915-491e-871e-f05d6dfe518d req-208eff4d-06a9-45a7-9b89-d3985b82cf87 tempest-ListServerFiltersTestJSON-701955747 tempest-ListServerFiltersTestJSON-701955747-project-member] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 767.495536] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 767.495536] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.495536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.495687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.496071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.496071] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.496071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.496402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.496402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.496402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.496554] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.690461] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.690834] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.690834] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.691089] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.691236] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.691393] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 9b678728-48f0-431c-9b2d-0e8b70e7b780 not found, creating... [ 767.691644] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.691792] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.691906] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.692122] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.692250] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.692529] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.692803] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.692991] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.693344] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.693549] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.693766] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 9b678728-48f0-431c-9b2d-0e8b70e7b780 is going to be created. [ 767.723965] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.724186] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.724186] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.724426] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.724654] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.724887] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-9b678728-48f0-431c-9b2d-0e8b70e7b780" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.892948] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 767.893879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.893879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.893879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.893879] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.893879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.894204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.894204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.894204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.894291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.894403] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.998583] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.174873] env[66730]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 768.175042] env[66730]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] NSXv3 Agent Agent loop - iteration:1 started [ 768.398586] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.398756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.398828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.399097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.399253] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.399455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.399455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.399538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.399626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.399718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.399869] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.399962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.400031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.400174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.400311] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.400400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.400460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.400594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.400669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.400746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.400833] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.457432] env[66730]: INFO networking_nsxv3.common.synchronization [req-13112872-7178-44dd-acb3-71232de00c95 req-94856b4d-9b04-4eb6-b4d2-de7fe6fcaf93 service nova] Enqueued Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_rules [ 768.457432] env[66730]: INFO networking_nsxv3.common.synchronization [req-13112872-7178-44dd-acb3-71232de00c95 req-94856b4d-9b04-4eb6-b4d2-de7fe6fcaf93 service nova] Enqueued Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 768.457432] env[66730]: INFO networking_nsxv3.common.synchronization [req-13112872-7178-44dd-acb3-71232de00c95 req-94856b4d-9b04-4eb6-b4d2-de7fe6fcaf93 service nova] Enqueued Resource ID: 9b678728-48f0-431c-9b2d-0e8b70e7b780 with Priority: HIGHEST for action port [ 768.457432] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_rules [ 768.457432] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 768.457432] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b678728-48f0-431c-9b2d-0e8b70e7b780 with Priority: HIGHEST for action port [ 768.457432] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.457432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.457432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.458652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.458652] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.460187] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.460316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.460617] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b678728-48f0-431c-9b2d-0e8b70e7b780 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.460773] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b678728-48f0-431c-9b2d-0e8b70e7b780" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.460872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b678728-48f0-431c-9b2d-0e8b70e7b780" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.461154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b678728-48f0-431c-9b2d-0e8b70e7b780" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.461275] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b678728-48f0-431c-9b2d-0e8b70e7b780',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.501467] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.902891] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f: rpc.has_security_group_logging(os_id): False [ 768.930257] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.930488] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.930603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.930908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.931084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.931350] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.931455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.931519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.931722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.931802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.932016] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.934794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.934794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.934982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.935038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.935264] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.935373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.935434] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.935640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.935740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.935782] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be created. [ 768.961081] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.961218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.963709] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b678728-48f0-431c-9b2d-0e8b70e7b780 with status ACTIVE [ 768.964145] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.964301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.964370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.964590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.964683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.964875] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.964980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.965069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.965252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.965337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.965536] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.965666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.965794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.965848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.965902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.965999] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b678728-48f0-431c-9b2d-0e8b70e7b780 is going to be updated. [ 768.992575] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.992817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.992897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.993152] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.993294] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.993472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b678728-48f0-431c-9b2d-0e8b70e7b780" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.005632] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.005796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.005861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.006154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.006367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.008125] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.008262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.008389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.008597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.008683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.008781] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be updated. [ 769.022357] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 769.058536] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.058675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.058751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.058965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.059142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.090253] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 769.175530] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: SUCCESS [ 769.175806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.176033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.176356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.176557] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.176704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.176804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.177019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.177151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.177281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.177406] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.312339] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: SUCCESS [ 769.312632] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 deletion is rescheduled due to dependency. [ 769.312632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.312797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.313064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.313303] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.313465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.313545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.313703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.313786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.313891] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.680541] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.680745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.681176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.681176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.681274] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.681375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.681465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.681646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.681752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.681871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.682080] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.682212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.682291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.682464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.683021] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.683021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.683021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.683181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.683181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.683263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.683376] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.816894] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.983427] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.983427] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.983840] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.983840] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.983999] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.984148] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.984260] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.984448] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.984583] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.985017] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.985017] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.985017] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.985136] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.985178] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.985258] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.985381] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.007402] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.007510] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 770.007567] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.007737] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.009305] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-8de1b916-dc96-492f-ab32-fd36252b6b08 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.009305] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.009305] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.009305] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.009305] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de1b916-dc96-492f-ab32-fd36252b6b08',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.186034] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398600ce-6668-4055-9c7c-d60ad413bf9d: rpc.has_security_group_logging(os_id): False [ 770.204949] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.205109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.205183] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.205397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.205505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.205720] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.205819] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.205884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.206059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.206139] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.206313] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.206407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.206469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.206609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.206684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.206860] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.206967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.207180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.207347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.207425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.207513] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d is going to be updated. [ 770.284000] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.284256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.284256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.284423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.284583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.305401] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: IN_PROGRESS for 2s [ 770.319900] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.511280] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.511495] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.511617] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.511992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.512074] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.512319] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.512471] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.512586] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.513279] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.513279] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.513279] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.513497] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.513497] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.513667] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.513791] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.513923] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 8de1b916-dc96-492f-ab32-fd36252b6b08 is going to be updated. [ 770.540299] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.540665] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.540883] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.541500] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.541718] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.542150] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.826194] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.826194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.826194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.826194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.826194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.826194] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 is going to be updated. [ 770.857346] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.857520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.857565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.857870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.858116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.869264] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: IN_PROGRESS for 2s [ 771.036647] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 771.037013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.100393] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 771.100609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.272290] env[66730]: INFO networking_nsxv3.common.synchronization [req-c09482db-72f4-4c18-96d0-3c1769805481 req-2eb1439c-26bc-4771-8380-11681abdd820 service nova] Enqueued Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_rules [ 771.272527] env[66730]: INFO networking_nsxv3.common.synchronization [req-c09482db-72f4-4c18-96d0-3c1769805481 req-2eb1439c-26bc-4771-8380-11681abdd820 service nova] Enqueued Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_members [ 771.272788] env[66730]: INFO networking_nsxv3.common.synchronization [req-c09482db-72f4-4c18-96d0-3c1769805481 req-2eb1439c-26bc-4771-8380-11681abdd820 service nova] Enqueued Resource ID: 8de1b916-dc96-492f-ab32-fd36252b6b08 with Priority: HIGHEST for action port [ 771.273133] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_rules [ 771.273269] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_members [ 771.273366] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de1b916-dc96-492f-ab32-fd36252b6b08 with Priority: HIGHEST for action port [ 771.273798] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.273798] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.274426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.274579] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.274673] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.275923] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.276058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.276129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.276343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.276502] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.276600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.276660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.276809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.277089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.277089] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.280731] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-8de1b916-dc96-492f-ab32-fd36252b6b08 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.280860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.281777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.281777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.281777] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de1b916-dc96-492f-ab32-fd36252b6b08',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.783264] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.783433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.783585] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.784478] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8de1b916-dc96-492f-ab32-fd36252b6b08 with status ACTIVE [ 771.784649] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.784757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.785019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.785229] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.785311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.785541] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.785642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.785701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.785856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.785967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.786624] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.786720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.786815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.786945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.786994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.787108] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8de1b916-dc96-492f-ab32-fd36252b6b08 is going to be updated. [ 771.813998] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.813998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.814170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.814320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.814806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.814806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8de1b916-dc96-492f-ab32-fd36252b6b08" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.290060] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.321691] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: SUCCESS [ 772.321910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.462510] env[66730]: INFO networking_nsxv3.common.synchronization [None req-5013ef1e-70a8-4b4b-bd52-e03af7bdcfac None None] Enqueued Resource ID: 757f3989-a25d-456f-b85f-a15c3efd82bc with Priority: HIGHEST for action port [ 772.463758] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 757f3989-a25d-456f-b85f-a15c3efd82bc with Priority: HIGHEST for action port [ 772.463758] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-757f3989-a25d-456f-b85f-a15c3efd82bc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.463758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-757f3989-a25d-456f-b85f-a15c3efd82bc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.463758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-757f3989-a25d-456f-b85f-a15c3efd82bc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.468315] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-757f3989-a25d-456f-b85f-a15c3efd82bc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.468315] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('757f3989-a25d-456f-b85f-a15c3efd82bc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.799111] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.799245] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.799313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.799531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.799618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.799711] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 is going to be updated. [ 772.827526] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.827605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.827652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.827866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.828035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.837337] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: IN_PROGRESS for 2s [ 772.879985] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: SUCCESS [ 772.880218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.880378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.880589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.880777] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.880896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.880959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.881129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.881208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.881294] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.881383] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.971256] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 757f3989-a25d-456f-b85f-a15c3efd82bc [ 772.971487] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.971670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.971719] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.971923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.972020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.972121] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:757f3989-a25d-456f-b85f-a15c3efd82bc already deleted. [ 772.972205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-757f3989-a25d-456f-b85f-a15c3efd82bc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.385168] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.887234] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a144e600-f0ab-4527-b46f-661bc4067c25: rpc.has_security_group_logging(os_id): False [ 773.904765] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.904925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.904984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.905222] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.905310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.905569] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.905673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.906372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.906372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.906372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.906372] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 is going to be updated. [ 773.974272] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.974272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.974272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.974574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.974714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.989245] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: IN_PROGRESS for 2s [ 774.848557] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: SUCCESS [ 774.848789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.848931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.849217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.849475] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.849622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.849692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.849872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.849996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.850145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.850289] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.093794] env[66730]: INFO networking_nsxv3.common.synchronization [None req-8f3ddc0b-af86-41ff-8a9a-c909b6e7e317 None None] Enqueued Resource ID: 6c93d32d-643e-4681-a5fd-c5924144630c with Priority: HIGHEST for action port [ 775.093794] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c93d32d-643e-4681-a5fd-c5924144630c with Priority: HIGHEST for action port [ 775.094079] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c93d32d-643e-4681-a5fd-c5924144630c taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.094079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c93d32d-643e-4681-a5fd-c5924144630c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.094177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c93d32d-643e-4681-a5fd-c5924144630c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.094344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c93d32d-643e-4681-a5fd-c5924144630c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.094429] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c93d32d-643e-4681-a5fd-c5924144630c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.353193] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.443449] env[66730]: INFO networking_nsxv3.common.synchronization [req-d4fcea06-a14c-43a1-b6cb-ffe3cea5c6e4 req-7ebc102f-387b-4525-a4da-38be2263802c tempest-ServerMetadataTestJSON-347358542 tempest-ServerMetadataTestJSON-347358542-project-member] Enqueued Resource ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 with Priority: HIGHEST for action security_group_members [ 775.444042] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 with Priority: HIGHEST for action security_group_members [ 775.444500] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe5a304a-21dc-43a8-b167-e76adbb7bc66 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.444625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.444693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.444943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.445066] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.445188] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.445221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.445429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.445581] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.445729] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe5a304a-21dc-43a8-b167-e76adbb7bc66',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.596680] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c93d32d-643e-4681-a5fd-c5924144630c [ 775.596962] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.597138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.597203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.597447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.597561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.597778] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c93d32d-643e-4681-a5fd-c5924144630c already deleted. [ 775.597925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c93d32d-643e-4681-a5fd-c5924144630c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.859377] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef7021c1-fc61-456d-b596-a046fb1931e7: rpc.has_security_group_logging(os_id): False [ 775.880681] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.880906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.881042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.881381] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.881503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.881875] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.882060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.882185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.882436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.882575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.882720] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 is going to be updated. [ 775.948844] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.949102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.949102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.949337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.949481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.949777] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.949879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.949879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.950052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.950139] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.950210] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 is going to be updated. [ 775.952194] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.952290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.952290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.952456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.952582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.975730] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: IN_PROGRESS for 2s [ 775.997283] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.997565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.997645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.997906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.998117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.010101] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 in Status: IN_PROGRESS for 2s [ 776.015261] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: SUCCESS [ 776.019891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.132197] env[66730]: INFO networking_nsxv3.common.synchronization [req-bb47cdbc-8d5b-439a-8a1a-159e7cc3ab68 req-29edd80c-6fdc-44fb-b125-0f3695e35f63 tempest-ServerTagsTestJSON-528081549 tempest-ServerTagsTestJSON-528081549-project-member] Enqueued Resource ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 with Priority: HIGHEST for action security_group_members [ 777.132197] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 with Priority: HIGHEST for action security_group_members [ 777.132197] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.132197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.132197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.132197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.132197] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.132197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.133256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.133594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.133790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.134086] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94ea1b6a-f403-40f1-b3c2-7f52a8429c38',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.638063] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.638256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.638306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.638635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.638810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.639095] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.639198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.639317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.639498] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.639599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.639717] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 is going to be updated. [ 777.685313] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.685476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.685540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.685764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.686177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.699101] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 in Status: IN_PROGRESS for 2s [ 778.001851] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: SUCCESS [ 778.001927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.027048] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 in Status: SUCCESS [ 778.027234] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 deletion is rescheduled due to dependency. [ 778.027365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.066449] env[66730]: INFO networking_nsxv3.common.synchronization [req-715d4103-c680-4cc0-9c74-86b26429948e req-c8b50272-3cb5-4df3-990a-e06176078ed1 tempest-ServerMetadataNegativeTestJSON-392678721 tempest-ServerMetadataNegativeTestJSON-392678721-project-member] Enqueued Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGHEST for action security_group_members [ 778.067164] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGHEST for action security_group_members [ 778.067514] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.067677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.067746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.071669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.071921] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.072061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.072133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.072345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.072432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.072550] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.461687] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-116 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.461687] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-116" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.461687] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-116" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.461687] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-116" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.461687] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.462562] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.462562] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.463634] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.463634] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.463778] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.463778] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.463853] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.463958] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.464079] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.464181] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.464309] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.493309] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.493513] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 778.493657] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.493833] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-116" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.494294] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-81e7d60f-0db2-4a28-acfe-41dc013a0a21 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.494478] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-81e7d60f-0db2-4a28-acfe-41dc013a0a21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.494599] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-81e7d60f-0db2-4a28-acfe-41dc013a0a21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.494940] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-81e7d60f-0db2-4a28-acfe-41dc013a0a21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.495159] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81e7d60f-0db2-4a28-acfe-41dc013a0a21',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.578065] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.578065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.578065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.578065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.578065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.578065] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.578065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.578065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.578065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.578065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.578065] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 already deleted. [ 778.578065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.998580] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.998825] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.999034] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.999336] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.999493] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.999641] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 81e7d60f-0db2-4a28-acfe-41dc013a0a21 not found, creating... [ 778.999897] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.000056] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.000165] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.000378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.000514] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.000783] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.000925] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.002021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.002021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.002021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.002021] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 81e7d60f-0db2-4a28-acfe-41dc013a0a21 is going to be created. [ 779.030710] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.030980] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.031182] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.035030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.035030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.035030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-81e7d60f-0db2-4a28-acfe-41dc013a0a21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.689127] env[66730]: INFO networking_nsxv3.common.synchronization [req-f00ec6af-209c-43fb-95b6-febae50bfdf6 req-c9127dc3-68c7-4455-b478-584b6c42c066 tempest-ServersAdminNegativeTestJSON-140283744 tempest-ServersAdminNegativeTestJSON-140283744-project-member] Enqueued Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 779.689739] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 779.690189] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.690338] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.690519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.690614] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.690780] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.690881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.690940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.691098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.691186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.691282] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.711936] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 in Status: SUCCESS [ 779.711936] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ea1b6a-f403-40f1-b3c2-7f52a8429c38 deletion is rescheduled due to dependency. [ 779.712069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ea1b6a-f403-40f1-b3c2-7f52a8429c38" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.843389] env[66730]: INFO networking_nsxv3.common.synchronization [req-715d4103-c680-4cc0-9c74-86b26429948e req-7c50f167-1b3c-4b29-a229-1770b0d153f2 service nova] Enqueued Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGHEST for action security_group_rules [ 779.843593] env[66730]: INFO networking_nsxv3.common.synchronization [req-715d4103-c680-4cc0-9c74-86b26429948e req-7c50f167-1b3c-4b29-a229-1770b0d153f2 service nova] Enqueued Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGHEST for action security_group_members [ 779.843690] env[66730]: INFO networking_nsxv3.common.synchronization [req-715d4103-c680-4cc0-9c74-86b26429948e req-7c50f167-1b3c-4b29-a229-1770b0d153f2 service nova] Enqueued Resource ID: 81e7d60f-0db2-4a28-acfe-41dc013a0a21 with Priority: HIGHEST for action port [ 779.843915] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGHEST for action security_group_rules [ 779.845589] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGHEST for action security_group_members [ 779.845795] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81e7d60f-0db2-4a28-acfe-41dc013a0a21 with Priority: HIGHEST for action port [ 779.846544] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.848096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.848096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.848096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.848096] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.848096] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.848528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.848528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.848528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.848676] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.848728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.848761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.848916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.848950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.849631] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.851677] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-81e7d60f-0db2-4a28-acfe-41dc013a0a21 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.851677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81e7d60f-0db2-4a28-acfe-41dc013a0a21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.851677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81e7d60f-0db2-4a28-acfe-41dc013a0a21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.851677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81e7d60f-0db2-4a28-acfe-41dc013a0a21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.851677] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81e7d60f-0db2-4a28-acfe-41dc013a0a21',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.024990] env[66730]: INFO networking_nsxv3.common.synchronization [req-59d7aeac-57a4-41c3-9207-5e5bd8207c5d req-4d1413f2-3957-4397-95b5-160c13c39eee tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 780.025665] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 780.026083] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.026237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.026377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.026553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.026721] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.026825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.026888] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.027056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.027145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.027240] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.195257] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.352943] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.353236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.353692] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.354867] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81e7d60f-0db2-4a28-acfe-41dc013a0a21 with status ACTIVE [ 780.355165] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.355400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.355460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.356655] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.356655] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.356655] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.356655] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.356655] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.356655] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.356655] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.356927] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.356927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.356927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.357111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.357111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.357167] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81e7d60f-0db2-4a28-acfe-41dc013a0a21 is going to be updated. [ 780.381444] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.382214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.382214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.382214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.382214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.382407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81e7d60f-0db2-4a28-acfe-41dc013a0a21" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.529942] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.530125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.530197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.530442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.530533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.530735] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.530883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.530963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.531155] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.531242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.531332] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 780.574174] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.574174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.574174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.574174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.574174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.587040] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 780.697122] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.814762] env[66730]: INFO networking_nsxv3.common.synchronization [req-5216514a-83dd-4416-802f-3f7ded2e050d req-a2f9f8c1-791c-423c-a5b1-c8f9e8134a7a tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 780.814962] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 780.815512] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.815512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.815622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.815841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.816563] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.816563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.816854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.817122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.818044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.818044] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.859421] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.202328] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.202625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.202625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.202780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.202872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.202975] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d is going to be updated. [ 781.241937] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.242156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.242156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.242521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.242664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.254374] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: IN_PROGRESS for 2s [ 781.286984] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.287276] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.287440] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.287803] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.287970] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.288309] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.288420] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.288773] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.288951] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.289214] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 781.289522] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 781.289522] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 781.289660] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 781.289782] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 781.289939] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 781.290112] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 781.320292] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.320522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.320522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.320871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.321142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.321641] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.321641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.321641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.321845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.321845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.322547] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 already deleted. [ 781.322547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.329098] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 781.329314] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 781.329461] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 781.330245] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.330890] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-4c7e24a8-b040-432e-8926-32888af4bb77 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.331255] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-4c7e24a8-b040-432e-8926-32888af4bb77" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.331556] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-4c7e24a8-b040-432e-8926-32888af4bb77" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.332079] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-4c7e24a8-b040-432e-8926-32888af4bb77" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.332263] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7e24a8-b040-432e-8926-32888af4bb77',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.362235] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.362506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.362637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.362825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.362924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.363048] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 is going to be created. [ 781.390731] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.390917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.390917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.391113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.391270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.405549] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 in Status: UNINITIALIZED for 2s [ 781.834628] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.835298] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.835298] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.835298] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.835430] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.835556] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 4c7e24a8-b040-432e-8926-32888af4bb77 not found, creating... [ 781.835809] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.835986] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.836122] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.836339] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.836473] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.836973] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.837148] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.837218] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.837452] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.837621] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.837867] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 4c7e24a8-b040-432e-8926-32888af4bb77 is going to be created. [ 781.861303] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.861739] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.861739] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.862056] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.862323] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.862581] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-4c7e24a8-b040-432e-8926-32888af4bb77" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.586764] env[66730]: INFO networking_nsxv3.common.synchronization [req-5216514a-83dd-4416-802f-3f7ded2e050d req-abe476a4-0880-418b-9bf5-748b0cc12fc4 service nova] Enqueued Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_rules [ 782.586940] env[66730]: INFO networking_nsxv3.common.synchronization [req-5216514a-83dd-4416-802f-3f7ded2e050d req-abe476a4-0880-418b-9bf5-748b0cc12fc4 service nova] Enqueued Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 782.587119] env[66730]: INFO networking_nsxv3.common.synchronization [req-5216514a-83dd-4416-802f-3f7ded2e050d req-abe476a4-0880-418b-9bf5-748b0cc12fc4 service nova] Enqueued Resource ID: 4c7e24a8-b040-432e-8926-32888af4bb77 with Priority: HIGHEST for action port [ 782.587732] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_rules [ 782.587902] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 782.588040] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c7e24a8-b040-432e-8926-32888af4bb77 with Priority: HIGHEST for action port [ 782.589330] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.589542] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.589542] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.589739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.589821] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.590917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.591795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.591891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.595025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.595025] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.595025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.595025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.595025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.595025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.595025] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.595714] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c7e24a8-b040-432e-8926-32888af4bb77 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.595714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c7e24a8-b040-432e-8926-32888af4bb77" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.595714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c7e24a8-b040-432e-8926-32888af4bb77" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.595714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c7e24a8-b040-432e-8926-32888af4bb77" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.596043] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7e24a8-b040-432e-8926-32888af4bb77',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.612840] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 782.613042] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f deletion is rescheduled due to dependency. [ 782.613192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.098567] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.098821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.102673] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c7e24a8-b040-432e-8926-32888af4bb77 with status ACTIVE [ 783.102991] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.103201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.103312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.103635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.103776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.104053] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.104214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.104331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.104573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.104693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.105078] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.105146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.105255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.105442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.105564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.105694] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c7e24a8-b040-432e-8926-32888af4bb77 is going to be updated. [ 783.108639] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.134380] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.134649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.134801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.135116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.135433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.135845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c7e24a8-b040-432e-8926-32888af4bb77" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.296026] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: SUCCESS [ 783.296211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.416183] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 in Status: SUCCESS [ 783.416950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.416950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.416950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.416950] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.417197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.417197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.417348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.417348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.417423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.417517] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.611376] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.922462] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.922662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.922783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.923086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.923264] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.923361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.923447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.923573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.924794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.924794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.924794] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.924794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.924794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.924794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.924794] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.924794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.924794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.924794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.924794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.924794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.925238] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.113508] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.117128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.117128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.117128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.117128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.117128] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 is going to be created. [ 784.141363] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.141594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.141657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.141824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.143034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.152698] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: UNINITIALIZED for 2s [ 784.186420] env[66730]: INFO networking_nsxv3.common.synchronization [req-e6de6fe0-4b91-4ef5-819d-80f9eca64184 req-d9828354-17a8-48f7-a061-8c2874f59cba tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_members [ 784.186420] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d40e47e-8889-4be5-a560-287881831b93 with Priority: HIGHEST for action security_group_members [ 784.186420] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d40e47e-8889-4be5-a560-287881831b93 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.186420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.186420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.186420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.186420] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.186420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.186420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.186420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.186973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.186973] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d40e47e-8889-4be5-a560-287881831b93',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.428167] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d3640ab-f13b-4406-87d7-65990dfad6d1: rpc.has_security_group_logging(os_id): False [ 784.451474] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.451850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.451850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.451973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.452018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.452218] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.452315] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.452375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.452547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.452626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.452814] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.452910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.453012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.453142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.453186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.453366] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.453608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.453608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.455316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.455316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.455316] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 is going to be created. [ 784.531359] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.531359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.531539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.531626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.532162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.549938] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 in Status: IN_PROGRESS for 2s [ 784.689828] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.690048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.690107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.690377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.690539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.690957] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.690957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.690957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.691312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.691312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.691312] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d40e47e-8889-4be5-a560-287881831b93 is going to be updated. [ 784.744374] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.744538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.744636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.744906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.745072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.757639] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d40e47e-8889-4be5-a560-287881831b93 in Status: IN_PROGRESS for 2s [ 784.784034] env[66730]: INFO networking_nsxv3.common.synchronization [req-7541a3b1-8a82-4507-a021-2af0fe2a2375 req-9c1c584b-e161-46c0-b7de-47b486ec65a8 tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 784.784034] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 784.789622] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.789622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.789622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.789622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.789622] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.789622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.789622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.789622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.789622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.789622] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.124278] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.124549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.124549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.124757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.124875] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.168842] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.169049] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.169170] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.169508] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.169765] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.169915] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.170038] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.170260] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.170394] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.170633] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.170748] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.170848] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.170950] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.171065] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.171166] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.171291] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.192222] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.192875] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.193086] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.193265] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.193576] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-aac74381-f35c-4994-a303-bd65591adc40 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.193752] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-aac74381-f35c-4994-a303-bd65591adc40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.193865] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-aac74381-f35c-4994-a303-bd65591adc40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.194586] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-aac74381-f35c-4994-a303-bd65591adc40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.194731] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac74381-f35c-4994-a303-bd65591adc40',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.292221] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.292221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.292221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.292221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.292221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.292221] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.292221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.292221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.292221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.292221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.292221] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 already deleted. [ 785.292221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.631109] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.700163] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.700163] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.700163] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.700424] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.700530] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.700678] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port aac74381-f35c-4994-a303-bd65591adc40 not found, creating... [ 785.700986] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.701185] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.701338] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.701579] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.701734] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.702058] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.702213] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.702324] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.702526] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.702664] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.702875] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: aac74381-f35c-4994-a303-bd65591adc40 is going to be created. [ 785.729154] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.729348] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.729488] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.729856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.730100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.730319] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-aac74381-f35c-4994-a303-bd65591adc40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.134342] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.165898] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: SUCCESS [ 786.166163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.166376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.166623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.166850] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.167238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.167238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.167238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.167395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.167395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.167549] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.514170] env[66730]: INFO networking_nsxv3.common.synchronization [req-7541a3b1-8a82-4507-a021-2af0fe2a2375 req-48aee4f1-a5a2-41f4-98a1-b285e2cb9dcb service nova] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_rules [ 786.514170] env[66730]: INFO networking_nsxv3.common.synchronization [req-7541a3b1-8a82-4507-a021-2af0fe2a2375 req-48aee4f1-a5a2-41f4-98a1-b285e2cb9dcb service nova] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 786.514170] env[66730]: INFO networking_nsxv3.common.synchronization [req-7541a3b1-8a82-4507-a021-2af0fe2a2375 req-48aee4f1-a5a2-41f4-98a1-b285e2cb9dcb service nova] Enqueued Resource ID: aac74381-f35c-4994-a303-bd65591adc40 with Priority: HIGHEST for action port [ 786.515278] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_rules [ 786.515513] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 786.515793] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aac74381-f35c-4994-a303-bd65591adc40 with Priority: HIGHEST for action port [ 786.516137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.516380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.516464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.516697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.516783] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.518106] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.518585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.518585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.519226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.519226] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.519226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.519226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.519226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.519226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.519761] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.524923] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-aac74381-f35c-4994-a303-bd65591adc40 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.525109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aac74381-f35c-4994-a303-bd65591adc40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.525184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aac74381-f35c-4994-a303-bd65591adc40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.525376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aac74381-f35c-4994-a303-bd65591adc40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.525465] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac74381-f35c-4994-a303-bd65591adc40',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.568969] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 in Status: SUCCESS [ 786.568969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.639346] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 786.639464] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 786.672504] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.674292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.674377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.674759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.674818] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.676477] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.676477] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.676477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.676477] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.767584] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d40e47e-8889-4be5-a560-287881831b93 in Status: SUCCESS [ 786.767830] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d40e47e-8889-4be5-a560-287881831b93 deletion is rescheduled due to dependency. [ 786.767966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d40e47e-8889-4be5-a560-287881831b93" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.029613] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.030754] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.030916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.032749] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aac74381-f35c-4994-a303-bd65591adc40 with status ACTIVE [ 787.032749] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.032749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.032749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.032749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.032749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.032749] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.032749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.032749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.032749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.032749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.033184] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.033184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.033184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.035141] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.035141] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.035141] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aac74381-f35c-4994-a303-bd65591adc40 is going to be updated. [ 787.055715] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.055715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.055715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.055715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.055715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.055715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aac74381-f35c-4994-a303-bd65591adc40" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.179377] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ef57016-b424-4876-b955-b7af3e07c7c4: rpc.has_security_group_logging(os_id): False [ 787.203278] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.206026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.206026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.207050] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.207050] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.209206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.209206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.209470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.209470] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 is going to be created. [ 787.302053] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.302206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.302260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.302487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.302711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.317033] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: IN_PROGRESS for 2s [ 787.537516] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.561089] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.563352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.563352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.563352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.579113] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 787.579113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.580240] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 787.613963] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.614130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.614196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.614436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.621432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.622236] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 787.622422] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 787.622422] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 787.706045] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.706208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.706278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.706503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.707839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.708056] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 787.814061] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.814338] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.814420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.814693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.814965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.815254] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 787.895539] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.895699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.895736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.895961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.896148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.896384] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 787.896484] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7a03f84a-bddc-4833-9f99-c1dc77481962', '7d62c76c-0a88-45ac-87f2-2212482e3159', '3cb9f836-7c49-4a1b-a86b-eb440ff5bf25', '93b3bb93-84fc-4123-b0bf-5f1575fd424b', '398600ce-6668-4055-9c7c-d60ad413bf9d', 'c63f5ef2-5b7c-4817-aa38-f459fffee01a', '0ad5de68-7a54-4c50-932c-9a6fbf8463f4', 'd420ce27-a76a-40c4-b871-c1f69291d3f0', '8ee53c94-9752-4f10-9e4b-a94683550515', 'bdb05696-d6b8-4357-aa2d-95b0e293f154', 'ef7021c1-fc61-456d-b596-a046fb1931e7', 'fe5a304a-21dc-43a8-b167-e76adbb7bc66', '0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b', '82256170-3225-4c5e-8d50-3e71dc76c846', 'fee2eedb-c65a-44aa-aac1-bdad7895fbe4', '4d3640ab-f13b-4406-87d7-65990dfad6d1', '86bff83e-5f97-4faa-9dfa-26142c6b8cf5', '4547e193-954e-4aa0-b017-08b4a3a04519', '6dd73e9d-f53e-4682-9229-6fa30e9d8043', '5879e874-e4a6-4ef8-9300-0b701b2512ad', '400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0', '6ca41c1b-622d-4ab6-868b-84dca5e38456', '9ef57016-b424-4876-b955-b7af3e07c7c4', '9d40e47e-8889-4be5-a560-287881831b93', 'b4155358-3708-4cf2-b2a6-fe099ab35896', '11fac9ba-96d2-4dbb-99c3-f32131a3e0dc', '94ea1b6a-f403-40f1-b3c2-7f52a8429c38', '9ac62f82-b6ef-4c16-a3fd-c268cde0a17f', '90b73cdb-a74a-4eb6-9916-f76b4b7a65f9', '0a55c2a9-6077-4f76-8e80-8d941329a6ba', '7e4a2ee9-9ce1-46d2-900e-714dc4569d58', '3990207f-c264-4f81-b18d-55d8c1cd003e', 'a144e600-f0ab-4527-b46f-661bc4067c25', 'a985d046-799d-4d0f-ae02-11071c04b015', 'fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0', '34c5c58e-4b22-4273-bd10-70b2a85bf96a'} {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 787.896609] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 787.919040] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.919040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.919040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.919040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.919040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.919040] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 787.919040] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 787.919040] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 788.000547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.000724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.000792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.000985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.001760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.001997] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 788.002089] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 788.002162] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 788.002299] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 788.002299] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 788.002441] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGH for action security_group_rules [ 788.002478] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGH for action security_group_rules [ 788.002556] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 with Priority: HIGH for action security_group_rules [ 788.002607] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGH for action security_group_rules [ 788.002648] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGH for action security_group_rules [ 788.002707] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGH for action security_group_rules [ 788.002756] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 with Priority: HIGH for action security_group_rules [ 788.002823] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 with Priority: HIGH for action security_group_rules [ 788.002885] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ee53c94-9752-4f10-9e4b-a94683550515 with Priority: HIGH for action security_group_rules [ 788.002946] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGH for action security_group_rules [ 788.003017] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGH for action security_group_rules [ 788.003082] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 with Priority: HIGH for action security_group_rules [ 788.003190] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b with Priority: HIGH for action security_group_rules [ 788.003190] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82256170-3225-4c5e-8d50-3e71dc76c846 with Priority: HIGH for action security_group_rules [ 788.003335] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 with Priority: HIGH for action security_group_rules [ 788.003335] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGH for action security_group_rules [ 788.003421] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 with Priority: HIGH for action security_group_rules [ 788.003421] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGH for action security_group_rules [ 788.003504] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGH for action security_group_rules [ 788.003547] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad with Priority: HIGH for action security_group_rules [ 788.003624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.039542] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.039822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.039892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.040119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.040217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.040302] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be created. [ 788.068643] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.068787] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.068852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.069077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.069231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.081213] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: UNINITIALIZED for 2s [ 789.330381] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: SUCCESS [ 789.330751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.093656] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 790.093656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.093656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.093656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.093951] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.093951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.093951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.094212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.094212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.094405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.094405] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.597895] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.101939] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 395afc29-8cfd-45e2-9399-f1ce306e15d4: rpc.has_security_group_logging(os_id): False [ 791.129253] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.129253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.129253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.129253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.129253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.129253] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.129646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.129646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.129646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.129646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.129801] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be created. [ 791.205787] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.205974] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.206086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.206403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.206629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.221408] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 791.518088] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 791.518088] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 791.518088] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGH for action security_group_rules [ 791.519019] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 with Priority: HIGH for action security_group_rules [ 791.520049] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 with Priority: HIGH for action security_group_rules [ 791.520349] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 with Priority: HIGH for action security_group_rules [ 791.520509] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad with Priority: HIGH for action security_group_rules [ 791.520644] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGH for action security_group_rules [ 791.520788] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGH for action security_group_rules [ 791.520947] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 with Priority: HIGH for action security_group_rules [ 791.521054] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82256170-3225-4c5e-8d50-3e71dc76c846 with Priority: HIGH for action security_group_rules [ 791.521195] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGH for action security_group_rules [ 791.522704] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b with Priority: HIGH for action security_group_rules [ 791.522704] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 with Priority: HIGH for action security_group_rules [ 791.522704] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGH for action security_group_rules [ 791.522861] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 with Priority: HIGH for action security_group_rules [ 791.523123] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee53c94-9752-4f10-9e4b-a94683550515 with Priority: HIGH for action security_group_rules [ 791.523267] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGH for action security_group_rules [ 791.525032] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 with Priority: HIGH for action security_group_rules [ 791.525032] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGH for action security_group_rules [ 791.525032] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 with Priority: HIGH for action security_group_rules [ 791.525032] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b with Priority: HIGH for action security_group_rules [ 791.525032] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.525032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.525032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.525032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.525032] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.530230] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.530422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.530516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.530810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.530881] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cb9f836-7c49-4a1b-a86b-eb440ff5bf25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.534313] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ad5de68-7a54-4c50-932c-9a6fbf8463f4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.534313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.534313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.534313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.534313] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ad5de68-7a54-4c50-932c-9a6fbf8463f4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.535383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fee2eedb-c65a-44aa-aac1-bdad7895fbe4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.535606] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.535807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.535956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.536088] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fee2eedb-c65a-44aa-aac1-bdad7895fbe4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.537501] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5879e874-e4a6-4ef8-9300-0b701b2512ad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.537612] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.537715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.537844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.537919] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5879e874-e4a6-4ef8-9300-0b701b2512ad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.540422] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.540553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.540618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.540813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.540905] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.543781] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.543890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.543992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.544473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.544565] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.545593] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86bff83e-5f97-4faa-9dfa-26142c6b8cf5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.545746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.545746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.545906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.545975] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86bff83e-5f97-4faa-9dfa-26142c6b8cf5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.547210] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82256170-3225-4c5e-8d50-3e71dc76c846 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.547328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.547393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.547583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.547642] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82256170-3225-4c5e-8d50-3e71dc76c846',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.552020] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.552020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.552020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.552020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.552020] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.552837] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.553226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.553226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.553226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.553368] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.553674] env[66730]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 791.554552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe5a304a-21dc-43a8-b167-e76adbb7bc66 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.554793] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.554882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.555055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.555125] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe5a304a-21dc-43a8-b167-e76adbb7bc66',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.556050] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.556195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.556238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.557019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.557019] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.557327] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdb05696-d6b8-4357-aa2d-95b0e293f154 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.557443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.557529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.557682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.557777] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdb05696-d6b8-4357-aa2d-95b0e293f154',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.560301] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ee53c94-9752-4f10-9e4b-a94683550515 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.560301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.560301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.560301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.560301] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ee53c94-9752-4f10-9e4b-a94683550515',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.560301] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.560301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.560976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.560976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.560976] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.562051] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d420ce27-a76a-40c4-b871-c1f69291d3f0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.562051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.562051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.562051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.562051] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d420ce27-a76a-40c4-b871-c1f69291d3f0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.562798] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.562798] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.562798] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.563029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.563029] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.564716] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d62c76c-0a88-45ac-87f2-2212482e3159 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.564716] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.564716] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.564716] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.564716] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d62c76c-0a88-45ac-87f2-2212482e3159',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.567155] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.567300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.567361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.568109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.568109] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93b3bb93-84fc-4123-b0bf-5f1575fd424b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.605684] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.608552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.608552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.608552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.642252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.642252] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ad5de68-7a54-4c50-932c-9a6fbf8463f4 is going to be deleted. [ 791.723119] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.723119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.723119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.723119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.723119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.723119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ad5de68-7a54-4c50-932c-9a6fbf8463f4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.074771] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.074771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.074771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.074771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.075038] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.075038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.075115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.075261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.075347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.075431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.075515] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.094502] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.094969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.094969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.094969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.124964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.125346] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cb9f836-7c49-4a1b-a86b-eb440ff5bf25 is going to be deleted. [ 792.132684] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.132970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.133106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.133402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.133634] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.133784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.133881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.134144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.134303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.134432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.134569] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.135526] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.136049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.136172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.136376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.136583] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.136726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.136824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.137034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.137168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.137295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.137418] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.139750] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.139952] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.140058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.140265] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.140466] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.140613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.140730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.140937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.141096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.141386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.141523] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.142493] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.142661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.142766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.142960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.143213] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.143314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.143431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.143616] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.143778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.143908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.144038] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.150702] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.150957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.151081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.151318] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.151536] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.151813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.151813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.152049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.152226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.152375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.152501] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.157957] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.158218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.158271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.158548] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.166888] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.167163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.167303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.167866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.168100] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.168262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.168413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.168745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.168922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.169626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.169626] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.169715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.169994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.169994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.170198] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.170337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.170432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.170617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.170740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.170874] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.170992] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.228925] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.229186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.230301] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.230301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.231394] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.231661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.232367] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.232534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.238740] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.240215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.240448] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.240639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.241990] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.241990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.243458] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.244028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.245369] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.245717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.246590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.246771] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82256170-3225-4c5e-8d50-3e71dc76c846 is going to be deleted. [ 792.248073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.248552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.251741] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.251741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.258181] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.258367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.274170] env[66730]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 792.275279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.275279] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d62c76c-0a88-45ac-87f2-2212482e3159 is going to be deleted. [ 792.276425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.276717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.309741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.310966] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5879e874-e4a6-4ef8-9300-0b701b2512ad is going to be deleted. [ 792.311343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.311637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.330992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.330992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.335146] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.335383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.342426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.343233] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93b3bb93-84fc-4123-b0bf-5f1575fd424b is going to be deleted. [ 792.343757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.344112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.372414] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.372829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.389863] env[66730]: INFO networking_nsxv3.common.synchronization [None req-a3bba37c-a43a-461e-9e02-824e65debd7d tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_rules [ 792.391444] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_rules [ 792.391444] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.391444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.391444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.391444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.391444] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.451036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.451036] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86bff83e-5f97-4faa-9dfa-26142c6b8cf5 is going to be deleted. [ 792.451723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.452490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.486481] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.487167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.504598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.506046] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fee2eedb-c65a-44aa-aac1-bdad7895fbe4 is going to be deleted. [ 792.511028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.511028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.578181] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.578181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.582029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.582029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.582029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.582029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.582029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.583261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.583261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.583261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.583261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.583494] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.601682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.602560] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdb05696-d6b8-4357-aa2d-95b0e293f154 is going to be deleted. [ 792.603833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.604013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.616074] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.616536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.658283] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.658572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.658658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.658957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.659275] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.659411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.659670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.660157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.660310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.660515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.660772] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.660943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.661099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.661363] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.661590] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.661758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.661862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.662110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.662256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.662403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.662555] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.664134] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.665224] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.667834] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.667988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.668093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.668853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.669117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.669234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.669234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.669425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.669597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.669714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.669878] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.669972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.670052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.670216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.670355] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.670453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.670517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.670680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.670755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.670819] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.670919] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.677266] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398600ce-6668-4055-9c7c-d60ad413bf9d: rpc.has_security_group_logging(os_id): False [ 792.705571] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.706283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.714027] env[66730]: INFO networking_nsxv3.common.synchronization [None req-3b12f4db-4be2-4b36-85eb-6c3341c6fb31 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_rules [ 792.714027] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_rules [ 792.715837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.716170] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d420ce27-a76a-40c4-b871-c1f69291d3f0 is going to be deleted. [ 792.717756] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.718865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.719464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.720338] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.783922] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.784145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.864479] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.867552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.867552] env[66730]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 792.867833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.867962] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be deleted. [ 792.869093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.869312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.907402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.907541] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ee53c94-9752-4f10-9e4b-a94683550515 is going to be deleted. [ 792.908639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.908932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.922822] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.923041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.967931] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.968168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.979230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.979486] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe5a304a-21dc-43a8-b167-e76adbb7bc66 is going to be deleted. [ 792.980661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.980914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.022414] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.022651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.028721] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.028721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.077390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.077557] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b is going to be deleted. [ 793.078680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.078950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.079061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.079190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cb9f836-7c49-4a1b-a86b-eb440ff5bf25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.079352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.079555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.079658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.079751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82256170-3225-4c5e-8d50-3e71dc76c846" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.081447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.081644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.081730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.082124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d62c76c-0a88-45ac-87f2-2212482e3159" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.082124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.082233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.082233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.082347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5879e874-e4a6-4ef8-9300-0b701b2512ad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.082456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.082594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.082670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.082781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93b3bb93-84fc-4123-b0bf-5f1575fd424b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.082907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.083059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.083357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.083357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86bff83e-5f97-4faa-9dfa-26142c6b8cf5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.083357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.083487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.083549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.083651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fee2eedb-c65a-44aa-aac1-bdad7895fbe4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.083768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.083898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.085397] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a03f84a-bddc-4833-9f99-c1dc77481962: rpc.has_security_group_logging(os_id): False [ 793.142627] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.142627] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.145989] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.146146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.154675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.155075] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.155708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.155708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.155708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.156102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.156102] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.156257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.156293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.156508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.156592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.156816] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.156908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.156968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.158012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.158107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.158222] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d is going to be updated. [ 793.160353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.160446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.160760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.160760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdb05696-d6b8-4357-aa2d-95b0e293f154" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.160913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.161060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.161163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.161284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d420ce27-a76a-40c4-b871-c1f69291d3f0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.161560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.161630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.161692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.161924] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 already deleted. [ 793.161924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.162147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.162332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.162413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.162544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.163215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.163511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.163633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.166408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ee53c94-9752-4f10-9e4b-a94683550515" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.166408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.166408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.166408] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.166408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.166408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.167753] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dd73e9d-f53e-4682-9229-6fa30e9d8043: rpc.has_security_group_logging(os_id): False [ 793.173260] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4547e193-954e-4aa0-b017-08b4a3a04519: rpc.has_security_group_logging(os_id): False [ 793.174483] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef7021c1-fc61-456d-b596-a046fb1931e7: rpc.has_security_group_logging(os_id): False [ 793.175426] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d3640ab-f13b-4406-87d7-65990dfad6d1: rpc.has_security_group_logging(os_id): False [ 793.205308] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.205500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.232438] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.232438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.237550] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.237550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.245672] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.245672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.250126] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.250126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.251990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.252326] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.252518] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.253078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.253078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.253078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.253385] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.253554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.253666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.253905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.254081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.254332] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.254477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.254592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.254819] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.254954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.255122] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be updated. [ 793.256640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.256869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.257024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.257214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe5a304a-21dc-43a8-b167-e76adbb7bc66" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.257422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.257657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.262100] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 793.262368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.373778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.375237] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.375237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.375237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.375237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.375237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.375237] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.375237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.375237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.375237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.375237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.375635] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.375635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.375635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.375635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.376811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.376811] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 is going to be updated. [ 793.377466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.377646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.418630] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.418851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.499029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.499029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.499029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.499029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.499029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.499029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.499029] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 is going to be updated. [ 793.499937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.500366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.500676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.503264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a1aebd7-b36c-4a5c-b35e-1f5761c63d3b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.503264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.503264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.520732] env[66730]: INFO networking_nsxv3.common.synchronization [None req-5c9875b8-a3f8-4c23-b24b-0b5e3bd62b2b None None] Enqueued Resource ID: 1a2d96cd-e363-48c9-9900-7b6db72d582a with Priority: HIGHEST for action port [ 793.521939] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2d96cd-e363-48c9-9900-7b6db72d582a with Priority: HIGHEST for action port [ 793.523946] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a2d96cd-e363-48c9-9900-7b6db72d582a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.523946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a2d96cd-e363-48c9-9900-7b6db72d582a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.523946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a2d96cd-e363-48c9-9900-7b6db72d582a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.523946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a2d96cd-e363-48c9-9900-7b6db72d582a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.523946] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a2d96cd-e363-48c9-9900-7b6db72d582a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.551736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.552062] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.552174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.552174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.552379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.552455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.553552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.553552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.553552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.553552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.553552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.553552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.553859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.553898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.555212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.555212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.555212] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 is going to be updated. [ 793.556646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.556646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.556646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.558124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.559288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.565567] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.565567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.617953] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: IN_PROGRESS for 2s [ 793.629590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.629941] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.630051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.630116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.630436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.630519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.631095] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 is going to be updated. [ 793.633604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.633958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.637288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.639937] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.641586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.641679] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.642828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.642828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.699243] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 in Status: IN_PROGRESS for 2s [ 793.709349] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.709739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.709739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.709942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.710122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.720912] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 793.723147] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.723147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.723147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.723147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.723147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.723147] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 already deleted. [ 793.723147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.731889] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: IN_PROGRESS for 2s [ 793.764943] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.764943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.764943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.764943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.764943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.787745] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: IN_PROGRESS for 2s [ 793.825030] env[66730]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 793.825030] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.825030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.825030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.825030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.825030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.890677] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: IN_PROGRESS for 2s [ 794.025659] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a2d96cd-e363-48c9-9900-7b6db72d582a [ 794.025766] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.025898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.026017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.026210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.026350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.026386] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a2d96cd-e363-48c9-9900-7b6db72d582a already deleted. [ 794.026468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a2d96cd-e363-48c9-9900-7b6db72d582a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.104356] env[66730]: INFO networking_nsxv3.common.synchronization [req-6e91a82b-ef8e-4cfa-817e-3033edc31b15 req-af843eb3-3522-4166-b4ad-5547cfcd541c tempest-ServerMetadataNegativeTestJSON-392678721 tempest-ServerMetadataNegativeTestJSON-392678721-project-member] Enqueued Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGHEST for action security_group_members [ 794.105781] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGHEST for action security_group_members [ 794.105781] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.105781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.105957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.106014] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.106307] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.106307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.106307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.106596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.106596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.106684] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.612499] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.612499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.612499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.612692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.612740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.613405] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.613405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.613405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.613405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.613405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.613405] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 is going to be updated. [ 794.666064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.666419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.666419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.666922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.666922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.690658] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 in Status: IN_PROGRESS for 2s [ 795.635624] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: SUCCESS [ 795.635624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.713901] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 in Status: SUCCESS [ 795.714636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.736360] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 795.736497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.746299] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: SUCCESS [ 795.746795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.803178] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: SUCCESS [ 795.803384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.907446] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: SUCCESS [ 795.909071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.230915] env[66730]: INFO networking_nsxv3.common.synchronization [None req-9dbe056a-3fbd-4a27-b8df-61e8b107a616 None None] Enqueued Resource ID: 2ce5d424-2f40-4e1c-a1d4-d55f5e168e73 with Priority: HIGHEST for action port [ 796.231510] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5d424-2f40-4e1c-a1d4-d55f5e168e73 with Priority: HIGHEST for action port [ 796.231846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ce5d424-2f40-4e1c-a1d4-d55f5e168e73 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.231970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ce5d424-2f40-4e1c-a1d4-d55f5e168e73" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.232658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ce5d424-2f40-4e1c-a1d4-d55f5e168e73" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.233584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ce5d424-2f40-4e1c-a1d4-d55f5e168e73" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.233691] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ce5d424-2f40-4e1c-a1d4-d55f5e168e73',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.391112] env[66730]: INFO networking_nsxv3.common.synchronization [req-00542441-35f5-4e1b-8424-e6cff95ed0f3 req-cc0af369-5a12-49c6-9a44-0c497f9235e0 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 796.391853] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 796.392388] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.392388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.392580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.393041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.393269] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.393478] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.393577] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.393809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.393980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.394097] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.706460] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 in Status: SUCCESS [ 796.706460] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 deletion is rescheduled due to dependency. [ 796.706460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.736476] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ce5d424-2f40-4e1c-a1d4-d55f5e168e73 [ 796.736740] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.737165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.737165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.737165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.737374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.737374] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ce5d424-2f40-4e1c-a1d4-d55f5e168e73 already deleted. [ 796.737432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ce5d424-2f40-4e1c-a1d4-d55f5e168e73" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.897832] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.898584] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.898584] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.898584] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.898782] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.898913] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.899418] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.899418] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.899418] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.899663] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.899785] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.899900] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.900028] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.900123] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.900227] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.900354] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.901865] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.901990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.902060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.902303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.902303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.902451] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.902542] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.902596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.902734] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.902807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.902891] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 already deleted. [ 796.902970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.930170] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.930318] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 796.930452] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.930628] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.930957] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-680370ef-913e-4ff1-aa3a-8bbcace44ce8 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.931149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-680370ef-913e-4ff1-aa3a-8bbcace44ce8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.931266] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-680370ef-913e-4ff1-aa3a-8bbcace44ce8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.932030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-680370ef-913e-4ff1-aa3a-8bbcace44ce8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.932030] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('680370ef-913e-4ff1-aa3a-8bbcace44ce8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.434266] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.434491] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.434618] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.434940] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.435099] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.435311] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 680370ef-913e-4ff1-aa3a-8bbcace44ce8 not found, creating... [ 797.435577] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.435753] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.435884] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.436110] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.436266] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.436549] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.436709] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.436835] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.437049] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.437182] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.437334] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 680370ef-913e-4ff1-aa3a-8bbcace44ce8 is going to be created. [ 797.458774] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.459014] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.459116] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.459398] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.459691] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.463577] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-680370ef-913e-4ff1-aa3a-8bbcace44ce8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.181667] env[66730]: INFO networking_nsxv3.common.synchronization [req-00542441-35f5-4e1b-8424-e6cff95ed0f3 req-27642c75-99ef-4925-8f0e-0c72cb91621e service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 798.181667] env[66730]: INFO networking_nsxv3.common.synchronization [req-00542441-35f5-4e1b-8424-e6cff95ed0f3 req-27642c75-99ef-4925-8f0e-0c72cb91621e service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 798.181667] env[66730]: INFO networking_nsxv3.common.synchronization [req-00542441-35f5-4e1b-8424-e6cff95ed0f3 req-27642c75-99ef-4925-8f0e-0c72cb91621e service nova] Enqueued Resource ID: 680370ef-913e-4ff1-aa3a-8bbcace44ce8 with Priority: HIGHEST for action port [ 798.181667] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 798.184419] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 798.184419] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 680370ef-913e-4ff1-aa3a-8bbcace44ce8 with Priority: HIGHEST for action port [ 798.184419] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.184419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.184419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.189883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.189883] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.189883] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.189883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.189883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.189883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.189883] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.189883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.189883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.189883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.189883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.189883] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.191925] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-680370ef-913e-4ff1-aa3a-8bbcace44ce8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.192190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-680370ef-913e-4ff1-aa3a-8bbcace44ce8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.192190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-680370ef-913e-4ff1-aa3a-8bbcace44ce8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.192314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-680370ef-913e-4ff1-aa3a-8bbcace44ce8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.192404] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('680370ef-913e-4ff1-aa3a-8bbcace44ce8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.696188] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.696379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.697302] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 680370ef-913e-4ff1-aa3a-8bbcace44ce8 with status ACTIVE [ 798.697302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.697302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.697302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.697302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.697302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.697600] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.697600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.697600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.698846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.698846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.698846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.698846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.698846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.698846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.698846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.698846] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 680370ef-913e-4ff1-aa3a-8bbcace44ce8 is going to be updated. [ 798.700015] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.725015] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.725187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.725288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.725522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.725721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.725907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-680370ef-913e-4ff1-aa3a-8bbcace44ce8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.205086] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.708194] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.708374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.708442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.708723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.708823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.708960] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be created. [ 799.734770] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.734965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.735024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.735211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.735368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.746483] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: UNINITIALIZED for 2s [ 801.274724] env[66730]: INFO networking_nsxv3.common.synchronization [req-44a220d5-f5cd-4a5f-a343-094d857517a6 req-dbdedfc7-3973-40e4-b932-fe8593658bfc tempest-ServersAdminTestJSON-1056025790 tempest-ServersAdminTestJSON-1056025790-project-member] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 801.274724] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 801.275035] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.275035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.275035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.275224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.275378] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.275760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.275760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.275760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.275887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.275918] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.758593] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 801.758880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.759148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.759430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.759690] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.759839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.759927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.760181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.760291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.760407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.760527] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.777528] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.817744] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.820100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.820100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.820100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.820100] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.820100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.820100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.820100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.820100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.820100] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.820509] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.821159] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.821159] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.821159] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.821159] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.821159] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.845555] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.845555] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 801.845555] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.845555] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-594" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.845555] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-4c35d434-43c8-473a-b6ba-fc6291168463 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.845555] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-4c35d434-43c8-473a-b6ba-fc6291168463" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.845837] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-4c35d434-43c8-473a-b6ba-fc6291168463" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.846229] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-4c35d434-43c8-473a-b6ba-fc6291168463" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.846229] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c35d434-43c8-473a-b6ba-fc6291168463',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.264383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.264536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.264708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.264835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.265008] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.265116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.265178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.265330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.265416] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.265502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.265648] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.265741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.265834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.265972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.266145] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.266263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.266327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.268285] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.268285] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.268285] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.268285] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.281941] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.349580] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.353028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.353028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.353028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.353028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.353028] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 4c35d434-43c8-473a-b6ba-fc6291168463 not found, creating... [ 802.353028] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.353028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.353028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.353028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.353028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.353577] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.353577] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.353577] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.353577] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.353577] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.353577] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 4c35d434-43c8-473a-b6ba-fc6291168463 is going to be created. [ 802.381075] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.381589] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.381589] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.381864] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.382222] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.382567] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-4c35d434-43c8-473a-b6ba-fc6291168463" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.769142] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5330f620-bc9e-4469-a7f3-c664f754a6e9: rpc.has_security_group_logging(os_id): False [ 802.783525] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.783525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.783525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.783895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.783895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.783895] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 802.802889] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.803065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.803126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.803344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.803477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.803781] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.803781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.803781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.803964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.804032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.804195] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.804302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.804337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.804472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.804844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.804844] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.804967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.805019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.805142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.805210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.805293] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be created. [ 802.829397] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.829617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.829617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.830508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.830508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.839674] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 802.899251] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.899251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.899251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.899251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.899251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.913322] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 803.136883] env[66730]: INFO networking_nsxv3.common.synchronization [req-44a220d5-f5cd-4a5f-a343-094d857517a6 req-3aa1694f-4361-4e23-b3f8-aece9cfdd2ca service nova] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_rules [ 803.136883] env[66730]: INFO networking_nsxv3.common.synchronization [req-44a220d5-f5cd-4a5f-a343-094d857517a6 req-3aa1694f-4361-4e23-b3f8-aece9cfdd2ca service nova] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 803.136985] env[66730]: INFO networking_nsxv3.common.synchronization [req-44a220d5-f5cd-4a5f-a343-094d857517a6 req-3aa1694f-4361-4e23-b3f8-aece9cfdd2ca service nova] Enqueued Resource ID: 4c35d434-43c8-473a-b6ba-fc6291168463 with Priority: HIGHEST for action port [ 803.137824] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_rules [ 803.137824] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 803.137961] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c35d434-43c8-473a-b6ba-fc6291168463 with Priority: HIGHEST for action port [ 803.138552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.138552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.138552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.138735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.138768] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.140634] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.140736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.140944] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c35d434-43c8-473a-b6ba-fc6291168463 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.141060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c35d434-43c8-473a-b6ba-fc6291168463" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.141126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c35d434-43c8-473a-b6ba-fc6291168463" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.141314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c35d434-43c8-473a-b6ba-fc6291168463" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.141412] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c35d434-43c8-473a-b6ba-fc6291168463',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.642123] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.642415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.644252] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c35d434-43c8-473a-b6ba-fc6291168463 with status ACTIVE [ 803.644462] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.644582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.644642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.645093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.645093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.645192] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.645258] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.645306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.645424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.645500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.645706] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.645839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.645908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.646069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.646154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.646224] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c35d434-43c8-473a-b6ba-fc6291168463 is going to be updated. [ 803.670284] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.670422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.670703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.670703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.670881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.670981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c35d434-43c8-473a-b6ba-fc6291168463" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.851843] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 804.852193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.852247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.852459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.852643] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.852765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.852827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.852973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.853061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.853153] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.926320] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 804.926645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.355349] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.858041] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.134869] env[66730]: INFO networking_nsxv3.common.synchronization [req-7809d2de-c409-49ed-81ba-89ac595dee5e req-56b19f63-8d5e-454a-8e02-f3fa8e093f34 tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 806.136760] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 806.139150] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.139150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.139150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.139150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.139150] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.139150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.139150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.139150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.139150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.139150] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.363843] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.366609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.366609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.366609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.366609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.366609] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 806.400339] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.400498] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.400568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.400811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.400972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.410518] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 806.576156] env[66730]: INFO networking_nsxv3.common.synchronization [req-7809d2de-c409-49ed-81ba-89ac595dee5e req-56b19f63-8d5e-454a-8e02-f3fa8e093f34 tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_rules [ 806.576311] env[66730]: INFO networking_nsxv3.common.synchronization [req-7809d2de-c409-49ed-81ba-89ac595dee5e req-56b19f63-8d5e-454a-8e02-f3fa8e093f34 tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 806.576475] env[66730]: INFO networking_nsxv3.common.synchronization [req-7809d2de-c409-49ed-81ba-89ac595dee5e req-56b19f63-8d5e-454a-8e02-f3fa8e093f34 tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: e47ade27-9288-46b6-b736-eba93fe189a5 with Priority: HIGHEST for action port [ 806.579437] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_rules [ 806.579712] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 806.579712] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e47ade27-9288-46b6-b736-eba93fe189a5 with Priority: HIGHEST for action port [ 806.580353] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.580499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.580567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.580853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.580940] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.582021] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.583784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.583784] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e47ade27-9288-46b6-b736-eba93fe189a5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.583784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.583784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.583784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.583784] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47ade27-9288-46b6-b736-eba93fe189a5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.641513] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.085821] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.086266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.086266] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e47ade27-9288-46b6-b736-eba93fe189a5 with status ACTIVE [ 807.086369] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.086464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.086613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.086903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.087037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.087221] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.087329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.087393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.087576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.087648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.087840] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.087932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.087993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.088173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.088246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.088344] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e47ade27-9288-46b6-b736-eba93fe189a5 is going to be updated. [ 807.114697] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.114938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.115070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.115262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.115403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.115564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.143389] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.646241] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.646396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.646462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.646776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.646900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.647016] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 is going to be updated. [ 807.679479] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.679479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.679820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.679820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.680024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.690179] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: IN_PROGRESS for 2s [ 808.422758] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 808.423146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.423331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.423469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.423666] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.423813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.423877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.424037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.424145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.424270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.424392] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.574896] env[66730]: INFO networking_nsxv3.common.synchronization [req-f9336122-ebce-4c2d-8277-214cde8a820f req-34cad3ab-8d22-46be-af8f-400c44d2cfa7 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 808.575490] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 808.575863] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.575994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.576566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.576566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.576566] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.576706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.576706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.576890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.576945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.577061] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.926901] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.927173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.927379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.927640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.927731] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.927837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.927901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.928081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.928221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.928269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.928398] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.928491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.928633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.928751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.928896] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.928989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.929066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.929209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.929276] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.929356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.929437] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.081646] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.081646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.081646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.081646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.081942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.081942] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.082048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.082048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.082203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.082260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.082333] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 809.117808] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.117960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.118020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.118386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.118541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.131729] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 809.385377] env[66730]: INFO networking_nsxv3.common.synchronization [req-ea0a7c85-57e8-4bef-92e7-6c9b1234a4bd req-ec86e645-4f9c-4fc7-84d3-b78bd02633e1 tempest-ListServerFiltersTestJSON-701955747 tempest-ListServerFiltersTestJSON-701955747-project-member] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 809.385985] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 809.386346] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.386473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.386569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.386811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.386972] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.387235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.387307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.387457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.387540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.387634] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.432475] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4155358-3708-4cf2-b2a6-fe099ab35896: rpc.has_security_group_logging(os_id): False [ 809.454926] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.455329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.455572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.456348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.478355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.478701] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.478914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.479016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.479207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.479306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.480010] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.480010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.480010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.480010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.480213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.480552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.480552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.480552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.480891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.480999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.481121] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 809.570122] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.570256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.570459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.571157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.571157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.589797] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 809.717360] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: SUCCESS [ 809.717584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.717777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.718117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.718290] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.718395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.718395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.718552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.718732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.718845] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.890291] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.221015] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.271091] env[66730]: INFO networking_nsxv3.common.synchronization [req-8c3e7862-699d-414b-8ece-0dc1ea90d8e6 req-675a462f-a67e-4843-b18c-aa89d1ea4539 tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 810.271544] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 810.272521] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.272521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.287227] env[66730]: INFO networking_nsxv3.common.synchronization [req-8c3e7862-699d-414b-8ece-0dc1ea90d8e6 req-675a462f-a67e-4843-b18c-aa89d1ea4539 tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_rules [ 810.287701] env[66730]: INFO networking_nsxv3.common.synchronization [req-8c3e7862-699d-414b-8ece-0dc1ea90d8e6 req-675a462f-a67e-4843-b18c-aa89d1ea4539 tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 810.288120] env[66730]: INFO networking_nsxv3.common.synchronization [req-8c3e7862-699d-414b-8ece-0dc1ea90d8e6 req-675a462f-a67e-4843-b18c-aa89d1ea4539 tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: e47ade27-9288-46b6-b736-eba93fe189a5 with Priority: HIGHEST for action port [ 810.288984] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_rules [ 810.289164] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 810.289325] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e47ade27-9288-46b6-b736-eba93fe189a5 with Priority: HIGHEST for action port [ 810.289704] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.289897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.290300] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.290300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.290544] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e47ade27-9288-46b6-b736-eba93fe189a5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.290544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.290544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.290758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.290842] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47ade27-9288-46b6-b736-eba93fe189a5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.392652] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.724982] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.795679] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e47ade27-9288-46b6-b736-eba93fe189a5 with status ACTIVE [ 810.795900] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.795975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.796915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.796915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.796915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.796915] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.796915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.796915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.797242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.797360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.797855] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.797855] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.798021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.798291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.798291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.798291] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e47ade27-9288-46b6-b736-eba93fe189a5 is going to be updated. [ 810.821413] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.821413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.821660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.821736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.821904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.822075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e47ade27-9288-46b6-b736-eba93fe189a5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.897127] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.897127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.897127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.897127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.897391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.897391] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be updated. [ 810.931156] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.931386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.931466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.931696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.931851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.949177] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 811.142163] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 811.142362] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 811.142478] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.229180] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.229180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.229646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.229646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.229777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.229993] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 is going to be updated. [ 811.268026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.268026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.268026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.268026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.268026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.278947] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: IN_PROGRESS for 2s [ 811.608502] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 811.608756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.625071] env[66730]: INFO networking_nsxv3.common.synchronization [req-edca9cf1-5e49-4bff-af92-33c87320381e req-b783a63b-3c04-4dfc-b52d-8601389da9ac tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 811.625634] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 811.625931] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.626163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.626440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.626807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.627018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.627155] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.627237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.627476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.627539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.627647] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.131225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.131646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.131646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.131646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.131813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.132160] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.132160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.132336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.132539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.132539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.132694] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 already deleted. [ 812.132694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.230812] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.231046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.231187] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.231606] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.231893] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.232093] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.232199] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.232534] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.235069] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.235069] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.235069] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.235069] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.235069] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.235069] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.235069] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.235069] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.262841] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.263149] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 812.263351] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.263597] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.264000] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-72a2c676-f2b6-406d-baeb-766b149f685d taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.264228] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-72a2c676-f2b6-406d-baeb-766b149f685d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.264427] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-72a2c676-f2b6-406d-baeb-766b149f685d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.264815] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-72a2c676-f2b6-406d-baeb-766b149f685d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.264987] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72a2c676-f2b6-406d-baeb-766b149f685d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.769664] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.769886] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.770011] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.770343] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.770502] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.770657] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 72a2c676-f2b6-406d-baeb-766b149f685d not found, creating... [ 812.770917] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.771082] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.771194] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.771421] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.771552] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.771842] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.776041] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.776246] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.776478] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.776641] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.776784] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 72a2c676-f2b6-406d-baeb-766b149f685d is going to be created. [ 812.812788] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.813013] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.813099] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.813425] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.813673] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.813936] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-72a2c676-f2b6-406d-baeb-766b149f685d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.961180] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 812.961617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.294201] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: SUCCESS [ 813.294504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.294782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.295049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.295254] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.295375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.295466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.295629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.295713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.295799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.295953] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.298694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.298977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.299199] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.300407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.300487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.300757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.300757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.300852] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.508451] env[66730]: INFO networking_nsxv3.common.synchronization [req-edca9cf1-5e49-4bff-af92-33c87320381e req-8681d379-7627-4495-b40f-c0dcb46dec9b service nova] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_rules [ 813.508787] env[66730]: INFO networking_nsxv3.common.synchronization [req-edca9cf1-5e49-4bff-af92-33c87320381e req-8681d379-7627-4495-b40f-c0dcb46dec9b service nova] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 813.508787] env[66730]: INFO networking_nsxv3.common.synchronization [req-edca9cf1-5e49-4bff-af92-33c87320381e req-8681d379-7627-4495-b40f-c0dcb46dec9b service nova] Enqueued Resource ID: 72a2c676-f2b6-406d-baeb-766b149f685d with Priority: HIGHEST for action port [ 813.509391] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_rules [ 813.509522] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 813.509641] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72a2c676-f2b6-406d-baeb-766b149f685d with Priority: HIGHEST for action port [ 813.510039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.510142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.510214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.510653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.510653] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.511645] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.511983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.511983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.512121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.512295] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.512404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.512469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.512623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.512710] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.512798] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.513772] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-72a2c676-f2b6-406d-baeb-766b149f685d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.513872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72a2c676-f2b6-406d-baeb-766b149f685d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.513947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72a2c676-f2b6-406d-baeb-766b149f685d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.514072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72a2c676-f2b6-406d-baeb-766b149f685d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.514229] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72a2c676-f2b6-406d-baeb-766b149f685d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.804210] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.805602] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.020029] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72a2c676-f2b6-406d-baeb-766b149f685d with status ACTIVE [ 814.020029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.020029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.020029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.020029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.020029] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72a2c676-f2b6-406d-baeb-766b149f685d is going to be updated. [ 814.022220] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.024634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.024634] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.046529] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.046529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.046529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.046529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.046529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.046529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72a2c676-f2b6-406d-baeb-766b149f685d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.097105] env[66730]: INFO networking_nsxv3.common.synchronization [None req-9bc88635-1532-4d14-ae69-59a6b04744b1 None None] Enqueued Resource ID: 0f458e20-68af-4b3f-a330-8e636d8b3804 with Priority: HIGHEST for action port [ 814.097903] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f458e20-68af-4b3f-a330-8e636d8b3804 with Priority: HIGHEST for action port [ 814.098262] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f458e20-68af-4b3f-a330-8e636d8b3804 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.098410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f458e20-68af-4b3f-a330-8e636d8b3804" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.098542] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f458e20-68af-4b3f-a330-8e636d8b3804" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.099534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f458e20-68af-4b3f-a330-8e636d8b3804" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.099534] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f458e20-68af-4b3f-a330-8e636d8b3804',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.311024] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4547e193-954e-4aa0-b017-08b4a3a04519: rpc.has_security_group_logging(os_id): False [ 814.311024] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.329879] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.329879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.329879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.329879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.329879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.330279] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.330279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.330421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.330477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.330528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.330611] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 is going to be updated. [ 814.401727] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.401955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.401955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.403732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.403894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.419146] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: IN_PROGRESS for 2s [ 814.490764] env[66730]: INFO networking_nsxv3.common.synchronization [req-6a3f2843-4460-42b7-9032-98f52fded8f7 req-ec39f83f-7b79-4b1b-889c-52aa4f6fb030 tempest-AttachInterfacesUnderV243Test-484898281 tempest-AttachInterfacesUnderV243Test-484898281-project-member] Enqueued Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 814.499174] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4547e193-954e-4aa0-b017-08b4a3a04519 with Priority: HIGHEST for action security_group_members [ 814.500115] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4547e193-954e-4aa0-b017-08b4a3a04519 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.500266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.525162] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.600890] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f458e20-68af-4b3f-a330-8e636d8b3804 [ 814.601248] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.601506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.601559] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.601743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.601831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.601930] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f458e20-68af-4b3f-a330-8e636d8b3804 already deleted. [ 814.602017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f458e20-68af-4b3f-a330-8e636d8b3804" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.813201] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.813402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.813481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.814139] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.814249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.814359] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 is going to be updated. [ 814.848116] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.848292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.848337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.848616] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.848756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.868135] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: IN_PROGRESS for 2s [ 815.028537] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.028996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.028996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.029184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.029244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.029301] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be created. [ 815.057345] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.057748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.057896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.058508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.058508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.077309] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: UNINITIALIZED for 2s [ 816.435577] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: SUCCESS [ 816.435900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.436031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.436269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.436375] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.883104] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4547e193-954e-4aa0-b017-08b4a3a04519 in Status: SUCCESS [ 816.883104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.883104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.883104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.883104] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.883104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.883104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.883104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.883104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.883104] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.958839] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.958839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.958839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.958839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.958839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.958839] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 is going to be deleted. [ 817.014986] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.015196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.015196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.016539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.016539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.016539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.090606] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 817.090825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.091018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.091254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.091746] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.091746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.091746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.091999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.091999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.091999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.092195] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.313048] env[66730]: INFO networking_nsxv3.common.synchronization [None req-56725ef4-b49c-448e-aa2e-e2b8025d2e27 None None] Enqueued Resource ID: 9d8a97e4-ff6e-4e82-9fe1-cc917882ddf7 with Priority: HIGHEST for action port [ 817.313048] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8a97e4-ff6e-4e82-9fe1-cc917882ddf7 with Priority: HIGHEST for action port [ 817.313875] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d8a97e4-ff6e-4e82-9fe1-cc917882ddf7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.314704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d8a97e4-ff6e-4e82-9fe1-cc917882ddf7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.315549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d8a97e4-ff6e-4e82-9fe1-cc917882ddf7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.317666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d8a97e4-ff6e-4e82-9fe1-cc917882ddf7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.317791] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d8a97e4-ff6e-4e82-9fe1-cc917882ddf7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.385381] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.385562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.385634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.385843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.385938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.386131] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.386221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.386314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.386419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.386495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.386606] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 is going to be deleted. [ 817.472371] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.472371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.472371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.472859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.472859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.472859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.474525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.474763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.475052] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.475147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.475187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.475367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.475447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.475845] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4547e193-954e-4aa0-b017-08b4a3a04519',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.595770] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.596068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.596068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.596334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.596564] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.596672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.596785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.597041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.597185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.597350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.597561] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.597698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.597859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.598030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.598172] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.598335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.598379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.598517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.598631] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.598712] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.598824] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.824741] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d8a97e4-ff6e-4e82-9fe1-cc917882ddf7 [ 817.825041] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.825225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.825320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.825617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.825727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.825884] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d8a97e4-ff6e-4e82-9fe1-cc917882ddf7 already deleted. [ 817.828018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d8a97e4-ff6e-4e82-9fe1-cc917882ddf7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.978503] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.980146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.980146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.980146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.980146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.980367] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.980494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.980562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.980747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.981055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.981055] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4547e193-954e-4aa0-b017-08b4a3a04519 already deleted. [ 817.981232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4547e193-954e-4aa0-b017-08b4a3a04519" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.104927] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f152db72-4e1f-4942-b241-530ee83d9bd1: rpc.has_security_group_logging(os_id): False [ 818.129774] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.129934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.130019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.130440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.130580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.130798] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.131028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.131195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.131245] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.131326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.131545] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.131637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.131713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.131856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.131974] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.132227] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.132329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.132389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.132526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.132597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.132678] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be created. [ 818.229240] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.229405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.229485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.229725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.229922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.244915] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 819.128536] env[66730]: INFO networking_nsxv3.common.synchronization [req-90d54ef2-2396-430a-b0a7-d4d5d9b56ced req-8bc999b7-7b29-4260-ac51-5e23948e218a tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 819.129079] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 819.129079] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.129218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.129218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.129393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.129534] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.129626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.129723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.129889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.129971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.130076] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.635225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.635225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.635225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.635225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.662219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.662519] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.662830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.662830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.663133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.663223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.663344] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 is going to be updated. [ 819.700621] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.700811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.700856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.701098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.703016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.713211] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: IN_PROGRESS for 2s [ 820.148600] env[66730]: INFO networking_nsxv3.common.synchronization [None req-de3744f0-af81-4903-9532-7df784bbcfd5 None None] Enqueued Resource ID: 30f8b5ea-5d7e-40b4-b56b-a05cfb79a7df with Priority: HIGHEST for action port [ 820.149274] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f8b5ea-5d7e-40b4-b56b-a05cfb79a7df with Priority: HIGHEST for action port [ 820.149588] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-30f8b5ea-5d7e-40b4-b56b-a05cfb79a7df taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.152259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30f8b5ea-5d7e-40b4-b56b-a05cfb79a7df" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.152259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30f8b5ea-5d7e-40b4-b56b-a05cfb79a7df" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.152259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30f8b5ea-5d7e-40b4-b56b-a05cfb79a7df" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.152259] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30f8b5ea-5d7e-40b4-b56b-a05cfb79a7df',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.257780] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 820.258761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.652564] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30f8b5ea-5d7e-40b4-b56b-a05cfb79a7df [ 820.652931] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.653103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.653162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.653376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.653458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.653614] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30f8b5ea-5d7e-40b4-b56b-a05cfb79a7df already deleted. [ 820.653701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30f8b5ea-5d7e-40b4-b56b-a05cfb79a7df" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.726039] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: SUCCESS [ 821.726400] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 deletion is rescheduled due to dependency. [ 821.726400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.858579] env[66730]: INFO networking_nsxv3.common.synchronization [req-e05cbe98-aeff-4ade-b0b3-31d6490bc77e req-f55b98af-3dd6-4e1b-b56d-d1439395c988 tempest-ServersAdminNegativeTestJSON-140283744 tempest-ServersAdminNegativeTestJSON-140283744-project-member] Enqueued Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 821.859168] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGHEST for action security_group_members [ 821.859476] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.859600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.859674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.859944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.860307] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.860376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.860421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.860584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.860740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.860740] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.995223] env[66730]: INFO networking_nsxv3.common.synchronization [None req-339805ba-5b15-495e-96ec-3fe0a6c7e251 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_rules [ 821.995779] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_rules [ 821.996093] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.996213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.996280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.996530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.996611] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a43e643f-8b52-4bbf-8dc6-b82fb3363343',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.107909] env[66730]: INFO networking_nsxv3.common.synchronization [None req-abe7e6d1-9afd-4858-bbfd-a493bb73cf83 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_rules [ 822.108525] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_rules [ 822.109054] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.109054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.362834] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.363340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.363597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.364022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.366045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.366045] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.366045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.366045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.366045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.366045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.366045] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d is going to be updated. [ 822.404090] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.405078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.405078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.405078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.405078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.418340] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: IN_PROGRESS for 2s [ 822.523427] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.523427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.523811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.523811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.523811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.523999] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 already deleted. [ 822.523999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.524161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.524262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.524342] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a43e643f-8b52-4bbf-8dc6-b82fb3363343',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.742794] env[66730]: INFO networking_nsxv3.common.synchronization [None req-a642e159-0c28-4f8f-833c-0ab4e77a79e8 None None] Enqueued Resource ID: 3c6b97e5-4ed1-4e34-b980-66a5f1d62cca with Priority: HIGHEST for action port [ 822.743375] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6b97e5-4ed1-4e34-b980-66a5f1d62cca with Priority: HIGHEST for action port [ 822.743684] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c6b97e5-4ed1-4e34-b980-66a5f1d62cca taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.743809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c6b97e5-4ed1-4e34-b980-66a5f1d62cca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.743876] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c6b97e5-4ed1-4e34-b980-66a5f1d62cca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.744491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c6b97e5-4ed1-4e34-b980-66a5f1d62cca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.744577] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c6b97e5-4ed1-4e34-b980-66a5f1d62cca',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.048274] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.048473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.048547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.048868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.048986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.049109] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 already deleted. [ 823.049204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.246928] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c6b97e5-4ed1-4e34-b980-66a5f1d62cca [ 823.247207] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.247372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.247436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.247653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.247775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.247901] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c6b97e5-4ed1-4e34-b980-66a5f1d62cca already deleted. [ 823.248111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c6b97e5-4ed1-4e34-b980-66a5f1d62cca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.432009] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398600ce-6668-4055-9c7c-d60ad413bf9d in Status: SUCCESS [ 824.432329] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d deletion is rescheduled due to dependency. [ 824.432329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.744798] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 827.745191] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 828.221968] env[66730]: INFO networking_nsxv3.common.synchronization [req-e0a5df32-7ddc-43a6-a57d-f76dcb9dd542 req-b29654ba-001d-4b35-8201-de35e35ff82b tempest-ImagesOneServerNegativeTestJSON-160835856 tempest-ImagesOneServerNegativeTestJSON-160835856-project-member] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 828.222508] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 828.222814] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.222934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.223041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.223367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.223498] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.223636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.223636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.223894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.223894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.223894] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.637901] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.638223] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.638414] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.638676] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.639083] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.644018] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.644018] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.644018] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.644018] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.644018] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.644018] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.644018] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.644018] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.644018] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.644018] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.644018] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.666618] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.666838] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.667085] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.667257] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-23" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.668038] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-fa4d78e4-d9b2-4d7b-b0f6-a887777edb49 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.668038] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-fa4d78e4-d9b2-4d7b-b0f6-a887777edb49" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.668038] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-fa4d78e4-d9b2-4d7b-b0f6-a887777edb49" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.668502] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-fa4d78e4-d9b2-4d7b-b0f6-a887777edb49" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.668570] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa4d78e4-d9b2-4d7b-b0f6-a887777edb49',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.726542] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.729426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.729426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.729426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.729426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.729426] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.729426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.729426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.729426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.729426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.729426] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be deleted. [ 828.757091] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.759076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.759076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.759076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.759076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.759076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.172176] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.172438] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.172519] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.172800] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.172946] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.173114] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port fa4d78e4-d9b2-4d7b-b0f6-a887777edb49 not found, creating... [ 829.173367] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.173541] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.173666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.173956] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.174106] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.174493] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.174679] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.174872] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.175191] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.177470] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.177470] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: fa4d78e4-d9b2-4d7b-b0f6-a887777edb49 is going to be created. [ 829.196989] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.197255] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.197435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.197751] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.198089] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.198339] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-fa4d78e4-d9b2-4d7b-b0f6-a887777edb49" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.005132] env[66730]: INFO networking_nsxv3.common.synchronization [req-e0a5df32-7ddc-43a6-a57d-f76dcb9dd542 req-0a285c7c-29f4-42e2-8387-29092749e841 service nova] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_rules [ 830.005482] env[66730]: INFO networking_nsxv3.common.synchronization [req-e0a5df32-7ddc-43a6-a57d-f76dcb9dd542 req-0a285c7c-29f4-42e2-8387-29092749e841 service nova] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 830.005482] env[66730]: INFO networking_nsxv3.common.synchronization [req-e0a5df32-7ddc-43a6-a57d-f76dcb9dd542 req-0a285c7c-29f4-42e2-8387-29092749e841 service nova] Enqueued Resource ID: fa4d78e4-d9b2-4d7b-b0f6-a887777edb49 with Priority: HIGHEST for action port [ 830.005971] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_rules [ 830.006129] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 830.006224] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4d78e4-d9b2-4d7b-b0f6-a887777edb49 with Priority: HIGHEST for action port [ 830.006498] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.006629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.006721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.006943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.007033] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.007891] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.008012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.008075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.008251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.008399] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.008494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.008555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.008931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.008931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.008931] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.010337] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa4d78e4-d9b2-4d7b-b0f6-a887777edb49 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.010337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa4d78e4-d9b2-4d7b-b0f6-a887777edb49" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.010337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa4d78e4-d9b2-4d7b-b0f6-a887777edb49" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.010337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa4d78e4-d9b2-4d7b-b0f6-a887777edb49" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.010720] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa4d78e4-d9b2-4d7b-b0f6-a887777edb49',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.512827] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.514654] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.514757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.515562] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa4d78e4-d9b2-4d7b-b0f6-a887777edb49 with status ACTIVE [ 830.515695] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.515884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.515955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.516234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.516304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.517144] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.517144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.517144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.517296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.517338] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.517523] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.517783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.517783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.517898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.517931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.518687] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa4d78e4-d9b2-4d7b-b0f6-a887777edb49 is going to be updated. [ 830.543858] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.544094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.544150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.544366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.544503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.544671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa4d78e4-d9b2-4d7b-b0f6-a887777edb49" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.016032] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.523658] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.523823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.525287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.525287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.525287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.525287] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be created. [ 831.552101] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.552287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.552380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.552668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.552884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.567847] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: UNINITIALIZED for 2s [ 831.909992] env[66730]: INFO networking_nsxv3.common.synchronization [req-2a369fed-6565-4c02-9f6f-9452bdc1eac9 req-5faa9c7b-e5e5-4df7-b1d6-d088a15ae5b0 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_members [ 831.910712] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_members [ 831.911658] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.911859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.911948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.912250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.912439] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.913699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.913699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.913699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.914044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.914044] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.285419] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.285880] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.285880] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.286147] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.286916] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.286916] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.286916] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.287297] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.287297] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.287399] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.287498] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.287690] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.287764] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.287819] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.287898] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.288040] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.324125] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.324125] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 832.324263] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.324390] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.324712] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-e37a0809-1064-4eb9-b01b-8b684de24988 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.324883] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-e37a0809-1064-4eb9-b01b-8b684de24988" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.325010] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-e37a0809-1064-4eb9-b01b-8b684de24988" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.325476] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-e37a0809-1064-4eb9-b01b-8b684de24988" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.325658] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e37a0809-1064-4eb9-b01b-8b684de24988',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.416979] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.417218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.417218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.417460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.417580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.417803] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.417958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.418022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.418146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.418259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.418318] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 already deleted. [ 832.418378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.828918] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.829341] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.829480] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.829799] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.829979] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.830176] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port e37a0809-1064-4eb9-b01b-8b684de24988 not found, creating... [ 832.830501] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.830665] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.830803] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.831079] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.831253] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.831547] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.831740] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.831860] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.832186] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.832358] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.832531] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: e37a0809-1064-4eb9-b01b-8b684de24988 is going to be created. [ 832.854915] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.855352] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.855597] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.855969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.856231] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.856631] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-e37a0809-1064-4eb9-b01b-8b684de24988" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.179234] env[66730]: INFO networking_nsxv3.common.synchronization [req-05d4102b-59e0-4bc4-a72a-53fc1a9234a5 req-6feddd3c-1673-4def-b99b-77d87398c302 tempest-AttachVolumeShelveTestJSON-1677719075 tempest-AttachVolumeShelveTestJSON-1677719075-project-member] Enqueued Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_members [ 833.180502] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGHEST for action security_group_members [ 833.180890] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.181037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.181148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.181489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.181736] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.181907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.182020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.182278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.182407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.182541] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.554250] env[66730]: INFO networking_nsxv3.common.synchronization [req-2a369fed-6565-4c02-9f6f-9452bdc1eac9 req-cacadb39-42f2-4ac6-917a-776fac6f04eb service nova] Enqueued Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_rules [ 833.554743] env[66730]: INFO networking_nsxv3.common.synchronization [req-2a369fed-6565-4c02-9f6f-9452bdc1eac9 req-cacadb39-42f2-4ac6-917a-776fac6f04eb service nova] Enqueued Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_members [ 833.555021] env[66730]: INFO networking_nsxv3.common.synchronization [req-2a369fed-6565-4c02-9f6f-9452bdc1eac9 req-cacadb39-42f2-4ac6-917a-776fac6f04eb service nova] Enqueued Resource ID: e37a0809-1064-4eb9-b01b-8b684de24988 with Priority: HIGHEST for action port [ 833.559335] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_rules [ 833.559586] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_members [ 833.559796] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e37a0809-1064-4eb9-b01b-8b684de24988 with Priority: HIGHEST for action port [ 833.560281] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.560485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.560602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.560917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.561113] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.562409] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.562590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.562800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.564693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.564806] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.564988] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.565119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.565383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.565533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.565695] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.567783] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e37a0809-1064-4eb9-b01b-8b684de24988 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.567968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e37a0809-1064-4eb9-b01b-8b684de24988" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.568101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e37a0809-1064-4eb9-b01b-8b684de24988" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.568476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e37a0809-1064-4eb9-b01b-8b684de24988" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.568808] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e37a0809-1064-4eb9-b01b-8b684de24988',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.583928] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: SUCCESS [ 833.584777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.585547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.585706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.585984] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.586617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.586782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.587054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.587217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.591096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.591306] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.685697] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.686153] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.686153] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.686153] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.686300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.686497] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.686564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.687080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.687080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.687080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.687080] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 is going to be updated. [ 833.848651] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.849565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.849700] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.850023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.850290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.878628] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: IN_PROGRESS for 2s [ 834.071138] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.072564] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.073992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.074327] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e37a0809-1064-4eb9-b01b-8b684de24988 with status ACTIVE [ 834.074609] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.074756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.074829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.075041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.075128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.075399] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.075399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.075492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.075667] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.076861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.076861] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.076861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.076861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.076861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.076861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.076861] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e37a0809-1064-4eb9-b01b-8b684de24988 is going to be updated. [ 834.094518] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.094746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.094840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.095153] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.095352] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.095504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.095602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.095806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.095928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.096105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.096348] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.096485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.096596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.096832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.096964] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.097908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.098054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.099455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.099455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.099455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.099455] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.101956] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.102084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.102144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.102373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.103104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.103104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e37a0809-1064-4eb9-b01b-8b684de24988" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.573665] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.603802] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c63f5ef2-5b7c-4817-aa38-f459fffee01a: rpc.has_security_group_logging(os_id): False [ 834.614553] env[66730]: INFO networking_nsxv3.common.synchronization [req-ede4bcf3-69a1-40f4-a0c5-a2d559c146b5 req-4694d438-7304-444e-b03d-729ac7eb01c4 tempest-InstanceActionsTestJSON-1291986938 tempest-InstanceActionsTestJSON-1291986938-project-member] Enqueued Resource ID: cec4659b-96ff-48b6-ae37-82937d12179a with Priority: HIGHEST for action security_group_members [ 834.615196] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec4659b-96ff-48b6-ae37-82937d12179a with Priority: HIGHEST for action security_group_members [ 834.615901] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec4659b-96ff-48b6-ae37-82937d12179a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.616063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.616162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.616475] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.616648] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.616839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.616912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.617091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.617249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.617291] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec4659b-96ff-48b6-ae37-82937d12179a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.625285] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.625430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.625502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.625704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.625801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.626098] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.626253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.626324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.626481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.626606] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.626982] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.627097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.627132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.627299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.627379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.627564] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.627658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.627738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.627975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.628143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.628319] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be created. [ 834.700522] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.700751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.700862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.701962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.701962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.726044] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: IN_PROGRESS for 2s [ 835.064043] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.064043] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-108" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.064043] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-108" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.064945] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-108" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.065415] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.065562] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.065612] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.066400] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.066598] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.067031] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 835.067167] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.067280] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.067444] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.067618] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 835.067618] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.067769] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.075468] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.075670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.075670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.077145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.077145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.077145] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 is going to be created. [ 835.092293] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.092293] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 835.092293] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.092477] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-108" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.092919] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-6c8cccdf-b53d-444e-96ea-ee34c0ce822c taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.093306] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-6c8cccdf-b53d-444e-96ea-ee34c0ce822c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.093497] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-6c8cccdf-b53d-444e-96ea-ee34c0ce822c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.093865] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-6c8cccdf-b53d-444e-96ea-ee34c0ce822c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.093963] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c8cccdf-b53d-444e-96ea-ee34c0ce822c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.105618] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.105756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.105822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.106069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.106226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.118674] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 in Status: UNINITIALIZED for 2s [ 835.120442] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.120569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.120641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.120863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.120952] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.121167] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.121304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.121382] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.121568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.121667] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.121759] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec4659b-96ff-48b6-ae37-82937d12179a already deleted. [ 835.121841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.597057] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.597609] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.597609] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.597850] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.598080] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.599060] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 6c8cccdf-b53d-444e-96ea-ee34c0ce822c not found, creating... [ 835.599060] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.599060] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.599333] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.599333] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.599530] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.599808] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.600190] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.600296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.600554] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.600758] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.600863] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 6c8cccdf-b53d-444e-96ea-ee34c0ce822c is going to be created. [ 835.644348] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.644616] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.644786] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.645180] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.645470] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.645773] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-6c8cccdf-b53d-444e-96ea-ee34c0ce822c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.897904] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7021c1-fc61-456d-b596-a046fb1931e7 in Status: SUCCESS [ 835.897904] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 deletion is rescheduled due to dependency. [ 835.897904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.465201] env[66730]: INFO networking_nsxv3.common.synchronization [req-ede4bcf3-69a1-40f4-a0c5-a2d559c146b5 req-02e23677-b645-4527-a663-be77737b8de4 service nova] Enqueued Resource ID: cec4659b-96ff-48b6-ae37-82937d12179a with Priority: HIGHEST for action security_group_rules [ 836.465387] env[66730]: INFO networking_nsxv3.common.synchronization [req-ede4bcf3-69a1-40f4-a0c5-a2d559c146b5 req-02e23677-b645-4527-a663-be77737b8de4 service nova] Enqueued Resource ID: cec4659b-96ff-48b6-ae37-82937d12179a with Priority: HIGHEST for action security_group_members [ 836.465527] env[66730]: INFO networking_nsxv3.common.synchronization [req-ede4bcf3-69a1-40f4-a0c5-a2d559c146b5 req-02e23677-b645-4527-a663-be77737b8de4 service nova] Enqueued Resource ID: 6c8cccdf-b53d-444e-96ea-ee34c0ce822c with Priority: HIGHEST for action port [ 836.466083] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec4659b-96ff-48b6-ae37-82937d12179a with Priority: HIGHEST for action security_group_rules [ 836.466230] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec4659b-96ff-48b6-ae37-82937d12179a with Priority: HIGHEST for action security_group_members [ 836.466328] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8cccdf-b53d-444e-96ea-ee34c0ce822c with Priority: HIGHEST for action port [ 836.466883] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cec4659b-96ff-48b6-ae37-82937d12179a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.466883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.466883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.467216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.467216] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cec4659b-96ff-48b6-ae37-82937d12179a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.468104] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec4659b-96ff-48b6-ae37-82937d12179a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.468222] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.468348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.468514] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.468591] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.468684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.468739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.468911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.469302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.469302] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec4659b-96ff-48b6-ae37-82937d12179a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.470424] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c8cccdf-b53d-444e-96ea-ee34c0ce822c taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.470498] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c8cccdf-b53d-444e-96ea-ee34c0ce822c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.470552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c8cccdf-b53d-444e-96ea-ee34c0ce822c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.470659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c8cccdf-b53d-444e-96ea-ee34c0ce822c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.470738] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c8cccdf-b53d-444e-96ea-ee34c0ce822c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.748633] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: SUCCESS [ 836.749298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.972273] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cec4659b-96ff-48b6-ae37-82937d12179a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.974319] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec4659b-96ff-48b6-ae37-82937d12179a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.974319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.974829] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c8cccdf-b53d-444e-96ea-ee34c0ce822c with status ACTIVE [ 836.975145] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.975300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.975388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.975623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.976076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.976322] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.976451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.976513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.976810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.976889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.977953] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.977953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.977953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.977953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.977953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.977953] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c8cccdf-b53d-444e-96ea-ee34c0ce822c is going to be updated. [ 837.001250] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.001453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.001501] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.001688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.001825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.001983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c8cccdf-b53d-444e-96ea-ee34c0ce822c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.130440] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 in Status: SUCCESS [ 837.130686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.131032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.131252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.131446] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.131551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.131609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.131776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.131842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.131936] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.132035] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.220358] env[66730]: INFO networking_nsxv3.common.synchronization [req-2ba853a9-c2a1-4903-b39e-e106f3d38f57 req-0910fa49-6201-48a3-9877-a2ed4b41c791 tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 837.220571] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 837.221127] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.221759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.221759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.221759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.221944] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.222344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.222344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.222344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.222565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.222565] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.476411] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cec4659b-96ff-48b6-ae37-82937d12179a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.636141] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.725548] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.726046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.726046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.726502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.726608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.726905] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.727107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.727107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.727355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.727443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.727607] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 837.780035] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.780035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.780035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.780035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.780035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.791795] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 837.980576] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.980805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.980805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.981075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.981299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.981299] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec4659b-96ff-48b6-ae37-82937d12179a is going to be created. [ 838.005738] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.006024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.006024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.006153] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.006380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.016913] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec4659b-96ff-48b6-ae37-82937d12179a in Status: UNINITIALIZED for 2s [ 838.138950] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91: rpc.has_security_group_logging(os_id): False [ 838.158841] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.159035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.159128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.159350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.159437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.159685] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.160018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.160018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.160118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.160150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.160360] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 is going to be created. [ 838.239075] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.239075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.239075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.239075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.239075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.258865] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 in Status: IN_PROGRESS for 2s [ 838.716123] env[66730]: INFO networking_nsxv3.common.synchronization [req-9e52ad67-fb66-4f1e-b3db-e5af6cff38d0 req-60477dc3-0ecf-4cdf-913a-698a7ef10552 tempest-MultipleCreateTestJSON-2049163218 tempest-MultipleCreateTestJSON-2049163218-project-member] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 838.717017] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 838.717489] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.717765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.717765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.718025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.718189] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.718340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.718406] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.718663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.718910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.718981] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.168936] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.168936] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.168936] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.168936] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.172125] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.172125] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.172125] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.172125] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.172125] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.172125] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.172125] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.172125] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.172125] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.172125] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.172125] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.172125] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.193552] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.193790] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 839.193999] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.194324] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.194691] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-588184f3-c623-427d-8416-24877804b2a3 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.194835] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-588184f3-c623-427d-8416-24877804b2a3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.194911] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-588184f3-c623-427d-8416-24877804b2a3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.195224] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-588184f3-c623-427d-8416-24877804b2a3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.197173] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('588184f3-c623-427d-8416-24877804b2a3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.223153] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.223413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.223413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.223670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.223766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.223995] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.224128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.224195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.224380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.224465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.224552] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b already deleted. [ 839.224660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.700108] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.700444] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.700614] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.700959] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.701196] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.701424] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 588184f3-c623-427d-8416-24877804b2a3 not found, creating... [ 839.701765] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.702047] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.702239] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.702486] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.702668] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.703050] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.703283] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.703418] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.703577] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.703726] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.703888] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 588184f3-c623-427d-8416-24877804b2a3 is going to be created. [ 839.729626] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.729869] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.730521] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.730521] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.730813] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.731009] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-588184f3-c623-427d-8416-24877804b2a3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.816172] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 839.816471] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 deletion is rescheduled due to dependency. [ 839.816553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.946839] env[66730]: INFO networking_nsxv3.common.synchronization [req-5ccaa0e5-1d7d-4373-aea4-05cb6613a657 req-079f4e4f-f23d-4445-b782-5c5ccb397545 tempest-ListServerFiltersTestJSON-701955747 tempest-ListServerFiltersTestJSON-701955747-project-member] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 839.947517] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGHEST for action security_group_members [ 839.948435] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.948579] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.948579] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.948750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.948945] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.949087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.949177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.949346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.949437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.949555] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.030940] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec4659b-96ff-48b6-ae37-82937d12179a in Status: SUCCESS [ 840.031289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.031598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.032126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.032483] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.032686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.032817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.033126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.033391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.033499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.033624] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cec4659b-96ff-48b6-ae37-82937d12179a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.272217] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 in Status: SUCCESS [ 840.272491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.452136] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.452311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.452371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.452603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.452694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.452898] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.452996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.453062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.453351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.453433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.453538] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be updated. [ 840.459152] env[66730]: INFO networking_nsxv3.common.synchronization [req-9e52ad67-fb66-4f1e-b3db-e5af6cff38d0 req-5940bad1-057e-426b-b6ae-ee6312bf7d10 service nova] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_rules [ 840.459329] env[66730]: INFO networking_nsxv3.common.synchronization [req-9e52ad67-fb66-4f1e-b3db-e5af6cff38d0 req-5940bad1-057e-426b-b6ae-ee6312bf7d10 service nova] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 840.459465] env[66730]: INFO networking_nsxv3.common.synchronization [req-9e52ad67-fb66-4f1e-b3db-e5af6cff38d0 req-5940bad1-057e-426b-b6ae-ee6312bf7d10 service nova] Enqueued Resource ID: 588184f3-c623-427d-8416-24877804b2a3 with Priority: HIGHEST for action port [ 840.460091] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_rules [ 840.460266] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 840.460404] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588184f3-c623-427d-8416-24877804b2a3 with Priority: HIGHEST for action port [ 840.460730] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.460816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.460916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.461201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.461315] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.462272] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.462385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.462453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.462617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.462758] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.462923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.462923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.463097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.463140] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.463225] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.466553] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-588184f3-c623-427d-8416-24877804b2a3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.466553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-588184f3-c623-427d-8416-24877804b2a3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.466553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-588184f3-c623-427d-8416-24877804b2a3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.466553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-588184f3-c623-427d-8416-24877804b2a3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.466553] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('588184f3-c623-427d-8416-24877804b2a3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.483954] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.485509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.485746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.486190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.486364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.499357] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: IN_PROGRESS for 2s [ 840.536846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec4659b-96ff-48b6-ae37-82937d12179a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.537034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.537093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.537337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.537485] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.537585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.537645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.537788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.537865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.537948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.538105] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec4659b-96ff-48b6-ae37-82937d12179a taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.538193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.538249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.538386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.538512] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.538609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.538671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.538910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.539741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.539741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.539741] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cec4659b-96ff-48b6-ae37-82937d12179a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.968160] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.969924] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.969924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.969924] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 588184f3-c623-427d-8416-24877804b2a3 with status ACTIVE [ 840.969924] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.969924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.969924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.969924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.969924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.970249] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.970249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.970249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.970400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.970519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.970879] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.970879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.970879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.971181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.971181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.971181] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 588184f3-c623-427d-8416-24877804b2a3 is going to be updated. [ 840.993919] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.993919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.993919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.993919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.993919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.993919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-588184f3-c623-427d-8416-24877804b2a3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.020067] env[66730]: INFO networking_nsxv3.common.synchronization [req-9e52ad67-fb66-4f1e-b3db-e5af6cff38d0 req-78c0719e-ef50-4011-81b6-65ba33772d4d tempest-MultipleCreateTestJSON-2049163218 tempest-MultipleCreateTestJSON-2049163218-project-member] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 841.021091] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 841.022029] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.022029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.041520] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cec4659b-96ff-48b6-ae37-82937d12179a: rpc.has_security_group_logging(os_id): False [ 841.067958] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.068143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.068405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.068507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.068562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.068899] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.069028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.069159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.069368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.069494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.069805] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.069805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.069927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.070195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.070257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.070525] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.070611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.070683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.071966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.071966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.072117] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cec4659b-96ff-48b6-ae37-82937d12179a is going to be created. [ 841.159376] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.159670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.159670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.159872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.160010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.176948] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cec4659b-96ff-48b6-ae37-82937d12179a in Status: IN_PROGRESS for 2s [ 841.389476] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.389824] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.389824] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.390066] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.390327] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.390485] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.390602] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.390824] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.390974] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.391220] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.391329] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.391485] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.391531] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.391694] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.391807] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.391952] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.413678] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.413852] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 841.413979] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.414210] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.414574] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-71087ad3-5e27-4101-8374-a074eb4302d8 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.414765] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-71087ad3-5e27-4101-8374-a074eb4302d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.414892] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-71087ad3-5e27-4101-8374-a074eb4302d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.415284] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-71087ad3-5e27-4101-8374-a074eb4302d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.415422] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71087ad3-5e27-4101-8374-a074eb4302d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.473185] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.917875] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.918213] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.918396] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.918746] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.918996] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.919194] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 71087ad3-5e27-4101-8374-a074eb4302d8 not found, creating... [ 841.919497] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.919654] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.919783] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.920139] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.920276] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.920616] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.920789] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.920930] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.921306] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.921471] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.921617] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 71087ad3-5e27-4101-8374-a074eb4302d8 is going to be created. [ 841.944827] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.945107] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.945168] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.945502] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.945770] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.946208] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-71087ad3-5e27-4101-8374-a074eb4302d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.975290] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.975526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.975582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.975792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.975889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.976091] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be created. [ 842.002580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.002837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.002837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.003074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.003307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.016594] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: UNINITIALIZED for 2s [ 842.512118] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 in Status: SUCCESS [ 842.512410] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 deletion is rescheduled due to dependency. [ 842.512410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.655717] env[66730]: INFO networking_nsxv3.common.synchronization [req-9e52ad67-fb66-4f1e-b3db-e5af6cff38d0 req-6139b641-cb16-470b-83f3-268ce3ac99e4 service nova] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_rules [ 842.655805] env[66730]: INFO networking_nsxv3.common.synchronization [req-9e52ad67-fb66-4f1e-b3db-e5af6cff38d0 req-6139b641-cb16-470b-83f3-268ce3ac99e4 service nova] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 842.655924] env[66730]: INFO networking_nsxv3.common.synchronization [req-9e52ad67-fb66-4f1e-b3db-e5af6cff38d0 req-6139b641-cb16-470b-83f3-268ce3ac99e4 service nova] Enqueued Resource ID: 71087ad3-5e27-4101-8374-a074eb4302d8 with Priority: HIGHEST for action port [ 842.656474] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_rules [ 842.656609] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 842.656704] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71087ad3-5e27-4101-8374-a074eb4302d8 with Priority: HIGHEST for action port [ 842.657689] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.657825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.658080] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.658174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.658400] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-71087ad3-5e27-4101-8374-a074eb4302d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.661251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71087ad3-5e27-4101-8374-a074eb4302d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.661295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71087ad3-5e27-4101-8374-a074eb4302d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.661511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71087ad3-5e27-4101-8374-a074eb4302d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.661598] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71087ad3-5e27-4101-8374-a074eb4302d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.166065] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71087ad3-5e27-4101-8374-a074eb4302d8 with status ACTIVE [ 843.166829] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.166829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.166829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.167307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.167307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.167307] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.167503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.167503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.167629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.167712] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.168506] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.168506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.168506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.168506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.168506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.168506] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71087ad3-5e27-4101-8374-a074eb4302d8 is going to be updated. [ 843.194243] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cec4659b-96ff-48b6-ae37-82937d12179a in Status: SUCCESS [ 843.194243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.194243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.194243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.194243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.194243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.194243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.194705] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71087ad3-5e27-4101-8374-a074eb4302d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.401574] env[66730]: INFO networking_nsxv3.common.synchronization [None req-5a39c947-8ff1-4114-9c55-48d3058db545 None None] Enqueued Resource ID: 0b5a566b-88db-41f2-bbf4-67ad4f9f1db0 with Priority: HIGHEST for action port [ 843.401731] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b5a566b-88db-41f2-bbf4-67ad4f9f1db0 with Priority: HIGHEST for action port [ 843.401909] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b5a566b-88db-41f2-bbf4-67ad4f9f1db0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.405370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b5a566b-88db-41f2-bbf4-67ad4f9f1db0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.405497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b5a566b-88db-41f2-bbf4-67ad4f9f1db0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.405808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b5a566b-88db-41f2-bbf4-67ad4f9f1db0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.405904] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b5a566b-88db-41f2-bbf4-67ad4f9f1db0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.910472] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b5a566b-88db-41f2-bbf4-67ad4f9f1db0 [ 843.910756] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.910897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.910985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.911302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.911370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.911421] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b5a566b-88db-41f2-bbf4-67ad4f9f1db0 already deleted. [ 843.911494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b5a566b-88db-41f2-bbf4-67ad4f9f1db0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.038471] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 844.038688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.038940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.039186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.039405] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.039544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.039624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.039763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.039839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.039978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.040068] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.040940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.041116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.042017] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.042017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.042017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.042017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.042017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.042017] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.545927] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.545927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.545927] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.922092] env[66730]: INFO networking_nsxv3.common.synchronization [None req-3d69b64d-6705-4bab-9962-8c0b5ab2f428 tempest-ServersTestFqdnHostnames-22117533 tempest-ServersTestFqdnHostnames-22117533-project-member] Enqueued Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_rules [ 844.922888] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_rules [ 844.922987] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.923137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.923201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.923458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.923568] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11cfe5ac-91a4-4528-906d-a180bf81f5e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.023741] env[66730]: INFO networking_nsxv3.common.synchronization [None req-4186a687-89b3-4478-8cd8-cd4e0bd3a7ed tempest-ServersTestFqdnHostnames-22117533 tempest-ServersTestFqdnHostnames-22117533-project-member] Enqueued Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_rules [ 845.023741] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_rules [ 845.023741] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.023741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.046862] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.445481] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.445628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.445833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.446063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.446153] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.446252] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 already deleted. [ 845.446335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.446481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.446634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.446730] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11cfe5ac-91a4-4528-906d-a180bf81f5e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.455241] env[66730]: INFO networking_nsxv3.common.synchronization [None req-69b12166-b6f6-4079-997f-83b00a83e412 tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_rules [ 845.455791] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_rules [ 845.456117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5161856-541b-4ad9-a7f2-629e78702077 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.456236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.456303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.456542] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.456622] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.550751] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.550751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.550751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.550751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.551093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.551093] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 845.584955] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.584955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.584955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.584955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.584955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.595272] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 845.657914] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7d659431-77ef-4b29-bc33-94894ed99ed4 tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_rules [ 845.660114] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_rules [ 845.660366] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5161856-541b-4ad9-a7f2-629e78702077 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.660545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.788637] env[66730]: INFO networking_nsxv3.common.synchronization [req-81bb3c80-07fc-4ff3-9b0c-cf1503e35128 req-88480bae-16f3-4bce-a6aa-442945ef5e39 tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 845.790995] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 845.794442] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.794627] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.794699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.795094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.795309] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.795445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.795515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.795722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.795821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.795925] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.841651] env[66730]: INFO networking_nsxv3.common.synchronization [None req-d9ff559b-b134-483f-a7cd-e7ed71ed2eeb None None] Enqueued Resource ID: 980b110c-da9b-44f8-9beb-936a4d78103a with Priority: HIGHEST for action port [ 845.841803] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 980b110c-da9b-44f8-9beb-936a4d78103a with Priority: HIGHEST for action port [ 845.846808] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-980b110c-da9b-44f8-9beb-936a4d78103a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.847194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-980b110c-da9b-44f8-9beb-936a4d78103a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.847441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-980b110c-da9b-44f8-9beb-936a4d78103a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.848023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-980b110c-da9b-44f8-9beb-936a4d78103a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.848247] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('980b110c-da9b-44f8-9beb-936a4d78103a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.970263] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.970263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.970263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.970263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.970263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.970263] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 already deleted. [ 845.970263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.978481] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.978481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.978481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.978481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.978481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.978481] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5161856-541b-4ad9-a7f2-629e78702077 already deleted. [ 845.978481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.978481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.978481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.978481] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.234417] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.234642] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.234735] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.235108] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.235391] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.235546] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.235660] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.235878] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.236042] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.236253] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.236365] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.236468] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.236571] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.236677] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.236862] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.236981] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.281761] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.281998] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 846.282118] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.282340] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.282726] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-71524284-41d7-44a3-acf5-f9ffd0d6214f taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.282941] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.283105] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.283511] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.283659] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71524284-41d7-44a3-acf5-f9ffd0d6214f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.302842] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.302842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.303052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.303216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.303330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.303515] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.303622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.303760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.303831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.303892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.303976] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb already deleted. [ 846.304065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.352334] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 980b110c-da9b-44f8-9beb-936a4d78103a [ 846.352583] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.352746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.352910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.353214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.353311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.353448] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:980b110c-da9b-44f8-9beb-936a4d78103a already deleted. [ 846.353570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-980b110c-da9b-44f8-9beb-936a4d78103a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.392669] env[66730]: INFO networking_nsxv3.common.synchronization [req-4137b9cd-0117-4cc8-a45a-76e4033b8176 req-03102b05-6f0d-4230-b053-67aba5177118 tempest-ImagesOneServerNegativeTestJSON-160835856 tempest-ImagesOneServerNegativeTestJSON-160835856-project-member] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 846.393290] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGHEST for action security_group_members [ 846.394751] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.394751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.394751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.394751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.394751] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.394751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.394751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.394751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.394751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.395204] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.501251] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.501365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.501441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.501663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.501755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.501853] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5161856-541b-4ad9-a7f2-629e78702077 already deleted. [ 846.501963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.786807] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.786807] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.787151] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.787196] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.787364] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.787522] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 71524284-41d7-44a3-acf5-f9ffd0d6214f not found, creating... [ 846.788242] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.788242] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.788242] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.788537] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.788715] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.790393] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.790770] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.790770] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.791110] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.791232] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.791431] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 71524284-41d7-44a3-acf5-f9ffd0d6214f is going to be created. [ 846.817343] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.817558] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.817661] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.817987] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.818836] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.818836] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.900054] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.900054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.900054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.900054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.900054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.900054] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.900054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.900054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.900054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.900054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.900054] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be updated. [ 846.931058] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.931281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.931281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.931548] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.931689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.947190] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: IN_PROGRESS for 2s [ 847.548117] env[66730]: INFO networking_nsxv3.common.synchronization [req-81bb3c80-07fc-4ff3-9b0c-cf1503e35128 req-2a6d8270-9a16-42ab-8dc5-6434bbbcb98b service nova] Enqueued Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_rules [ 847.548390] env[66730]: INFO networking_nsxv3.common.synchronization [req-81bb3c80-07fc-4ff3-9b0c-cf1503e35128 req-2a6d8270-9a16-42ab-8dc5-6434bbbcb98b service nova] Enqueued Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 847.548661] env[66730]: INFO networking_nsxv3.common.synchronization [req-81bb3c80-07fc-4ff3-9b0c-cf1503e35128 req-2a6d8270-9a16-42ab-8dc5-6434bbbcb98b service nova] Enqueued Resource ID: 71524284-41d7-44a3-acf5-f9ffd0d6214f with Priority: HIGHEST for action port [ 847.549627] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_rules [ 847.549782] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 847.550405] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71524284-41d7-44a3-acf5-f9ffd0d6214f with Priority: HIGHEST for action port [ 847.551122] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.551122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.551122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.551380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.551421] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.552468] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.552559] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.552728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.552812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.553089] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.553196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.553265] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.553468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.553553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.553647] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.554645] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-71524284-41d7-44a3-acf5-f9ffd0d6214f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.554751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.555659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.555659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.555659] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71524284-41d7-44a3-acf5-f9ffd0d6214f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.612511] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 847.612750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.612935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.613215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.613432] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.613556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.613623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.613812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.613896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.614012] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.059134] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.060252] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.060362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.060527] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71524284-41d7-44a3-acf5-f9ffd0d6214f with status ACTIVE [ 848.060682] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.060777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.060838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.061045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.061126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.061295] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.061380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.061479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.062233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.062233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.064785] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.064785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.064785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.064785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.064785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.064785] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71524284-41d7-44a3-acf5-f9ffd0d6214f is going to be updated. [ 848.087890] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.088123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.088123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.088285] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.088392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.088555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.117256] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.565430] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.621882] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.964626] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a in Status: SUCCESS [ 848.964919] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a deletion is rescheduled due to dependency. [ 848.965282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.071851] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.072237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.072427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.072617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.072716] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.072822] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb is going to be created. [ 849.108040] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.108040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.108040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.108040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.108040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.119238] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: UNINITIALIZED for 2s [ 849.124163] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.124325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.124441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.124677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.124810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.124965] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 849.164205] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.164205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.164205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.164205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.164205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.177373] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 851.132984] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: SUCCESS [ 851.133348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.133491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.133599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.133812] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.133931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.134040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.134197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.134272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.134366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.134439] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.189104] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 851.189389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.189572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.189811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.190056] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.190246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.190311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.190492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.190608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.190705] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.190922] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.191080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.191153] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.191306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.191462] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.191600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.191669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.191827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.191903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.191998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.192101] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.636570] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.636729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.636803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.637127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.637390] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.637586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.637650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.637920] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.638046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.638167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.638408] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.638560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.638657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.638839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.639033] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.639134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.639191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.639360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.639494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.639629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.639784] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.642670] env[66730]: INFO networking_nsxv3.common.synchronization [None req-5560a78e-8d82-4cf8-8c31-6fa0414c09e8 None None] Enqueued Resource ID: ba0b228c-703b-4895-be29-f65377349c80 with Priority: HIGHEST for action port [ 851.643302] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0b228c-703b-4895-be29-f65377349c80 with Priority: HIGHEST for action port [ 851.643632] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba0b228c-703b-4895-be29-f65377349c80 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.643800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba0b228c-703b-4895-be29-f65377349c80" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.643895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba0b228c-703b-4895-be29-f65377349c80" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.644238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba0b228c-703b-4895-be29-f65377349c80" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.644238] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba0b228c-703b-4895-be29-f65377349c80',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.669040] env[66730]: INFO networking_nsxv3.common.synchronization [req-ac1e9761-9b51-4953-b360-d4fa5ed0eb7b req-6c1867ad-ea25-4d66-89a5-40b0096bbde5 tempest-ServersAdminTestJSON-1056025790 tempest-ServersAdminTestJSON-1056025790-project-member] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 851.669683] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 851.671552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.671736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.671811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.672058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.672715] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.672715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.672715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.672715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.672956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.672956] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.694884] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 777ab4f0-3fef-4fad-954e-1a3565dcce4b: rpc.has_security_group_logging(os_id): False [ 851.716101] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.716971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.716971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.717176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.717176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.717389] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.717531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.717531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.720234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.720234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.720234] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.720234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.720234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.720234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.720234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.720234] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.720234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.720234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.720234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.720234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.720234] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be created. [ 851.802799] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.803122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.803376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.803624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.803938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.822272] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 852.146817] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa65d2d6-1889-401d-bf49-e6a36e79acbb: rpc.has_security_group_logging(os_id): False [ 852.147717] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba0b228c-703b-4895-be29-f65377349c80 [ 852.147978] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.148328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.148402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.148654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.148776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.149584] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba0b228c-703b-4895-be29-f65377349c80 already deleted. [ 852.149584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba0b228c-703b-4895-be29-f65377349c80" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.168200] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.168790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.168902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.169166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.169252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.169522] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.169793] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.170172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.170172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.170172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.173128] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.173128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.173128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.173128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.173128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.173128] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.173128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.173128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.173128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.173128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.173128] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb is going to be created. [ 852.175601] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.246639] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.246975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.246975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.247321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.247874] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.260586] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: IN_PROGRESS for 2s [ 852.679187] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.183407] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.183737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.183804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.184351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.184534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.184669] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 853.230043] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.230311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.230311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.230526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.230652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.247054] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 853.839284] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 853.839516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.839715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.839999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.840166] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.276304] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: SUCCESS [ 854.276578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.343103] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.343252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.343295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.343525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.343762] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.343814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.343868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.344059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.344172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.344327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.344401] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.528729] env[66730]: INFO networking_nsxv3.common.synchronization [req-f47fb530-e28b-48e5-be30-ccff6463aeec req-ecebfda5-5ccf-4103-a0e0-132be0f4db9a tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_members [ 854.529423] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_members [ 854.529738] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a43e643f-8b52-4bbf-8dc6-b82fb3363343 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.529904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.529992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.531420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.531678] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.531771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.531771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.531913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.531993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.532121] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a43e643f-8b52-4bbf-8dc6-b82fb3363343',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.847827] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.847827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.847827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.847827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.848204] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.848394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.848394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.848612] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.848648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.848772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.849085] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.849085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.849201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.849286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.849430] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.849523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.849587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.849749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.849827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.849937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.850037] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.018731] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.018996] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.019192] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.019513] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.019811] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.020057] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.020201] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.020461] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.020617] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.020837] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.020994] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.021135] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.021258] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.021467] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.021610] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.021739] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.034187] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.034359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.034436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.034665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.037780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.037780] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.037780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.037780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.037780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.037780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.037780] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 already deleted. [ 855.037780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.049596] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.050760] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 855.050760] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.050760] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.050760] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-d583ff23-0699-4b03-8641-4c2cdb740de9 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.051072] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-d583ff23-0699-4b03-8641-4c2cdb740de9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.051072] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-d583ff23-0699-4b03-8641-4c2cdb740de9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.051416] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-d583ff23-0699-4b03-8641-4c2cdb740de9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.051560] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d583ff23-0699-4b03-8641-4c2cdb740de9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.258589] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 855.258946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.352693] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 777ab4f0-3fef-4fad-954e-1a3565dcce4b: rpc.has_security_group_logging(os_id): False [ 855.372617] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.372814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.372896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.373131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.373247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.373483] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.373597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.373676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.373824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.373927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.374135] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.374244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.374309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.374429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.374993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.374993] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.374993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.374993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.375399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.375399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.375399] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 855.458692] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.458949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.458949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.459255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.459490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.471974] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 855.554054] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.554241] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.554354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.554572] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.554726] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.554883] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port d583ff23-0699-4b03-8641-4c2cdb740de9 not found, creating... [ 855.555178] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.555341] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.555457] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.555690] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.555827] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.556143] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.556304] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.556424] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.556637] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.556812] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.556969] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: d583ff23-0699-4b03-8641-4c2cdb740de9 is going to be created. [ 855.588934] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.589159] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.589278] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.589616] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.589860] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.590171] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-d583ff23-0699-4b03-8641-4c2cdb740de9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.322200] env[66730]: INFO networking_nsxv3.common.synchronization [req-f47fb530-e28b-48e5-be30-ccff6463aeec req-746814e2-79d1-4b8c-8e7c-f6666b308a7a service nova] Enqueued Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_rules [ 856.322515] env[66730]: INFO networking_nsxv3.common.synchronization [req-f47fb530-e28b-48e5-be30-ccff6463aeec req-746814e2-79d1-4b8c-8e7c-f6666b308a7a service nova] Enqueued Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_members [ 856.322687] env[66730]: INFO networking_nsxv3.common.synchronization [req-f47fb530-e28b-48e5-be30-ccff6463aeec req-746814e2-79d1-4b8c-8e7c-f6666b308a7a service nova] Enqueued Resource ID: d583ff23-0699-4b03-8641-4c2cdb740de9 with Priority: HIGHEST for action port [ 856.323799] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_rules [ 856.323902] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_members [ 856.324015] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d583ff23-0699-4b03-8641-4c2cdb740de9 with Priority: HIGHEST for action port [ 856.324338] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.324464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.324541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.324757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.326440] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a43e643f-8b52-4bbf-8dc6-b82fb3363343',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.327688] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a43e643f-8b52-4bbf-8dc6-b82fb3363343 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.327884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.327884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.328123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.328285] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.328385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.328438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.328610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.328706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.328810] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a43e643f-8b52-4bbf-8dc6-b82fb3363343',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.334963] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d583ff23-0699-4b03-8641-4c2cdb740de9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.335323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d583ff23-0699-4b03-8641-4c2cdb740de9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.335371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d583ff23-0699-4b03-8641-4c2cdb740de9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.339709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d583ff23-0699-4b03-8641-4c2cdb740de9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.339843] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d583ff23-0699-4b03-8641-4c2cdb740de9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.842928] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a43e643f-8b52-4bbf-8dc6-b82fb3363343 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.843309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.844717] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a43e643f-8b52-4bbf-8dc6-b82fb3363343',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.846272] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d583ff23-0699-4b03-8641-4c2cdb740de9 with status ACTIVE [ 856.846514] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.846674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.850022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.850022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.850022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.850022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.850594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.850594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.850594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.850594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.850854] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.850949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.851072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.851304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.851304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.851416] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d583ff23-0699-4b03-8641-4c2cdb740de9 is going to be updated. [ 856.877160] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.877160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.877160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.877160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.877384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.877522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d583ff23-0699-4b03-8641-4c2cdb740de9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.898478] env[66730]: INFO networking_nsxv3.common.synchronization [req-89ed5de9-df1f-4b88-bb67-8fc0dcd4852d req-1d6cf220-1287-4cb3-bc38-0665048daac6 tempest-MultipleCreateTestJSON-2049163218 tempest-MultipleCreateTestJSON-2049163218-project-member] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 856.899563] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 856.902684] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.902684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.902684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.902684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.902684] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.902684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.902684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.902684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.902684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.902684] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.177999] env[66730]: INFO networking_nsxv3.common.synchronization [req-839dcdfd-1826-457f-b6e5-ddff1de7c419 req-d886fbf5-8d60-4021-8b37-b0998ff57956 tempest-InstanceActionsTestJSON-1291986938 tempest-InstanceActionsTestJSON-1291986938-project-member] Enqueued Resource ID: cec4659b-96ff-48b6-ae37-82937d12179a with Priority: HIGHEST for action security_group_members [ 857.178565] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec4659b-96ff-48b6-ae37-82937d12179a with Priority: HIGHEST for action security_group_members [ 857.178962] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec4659b-96ff-48b6-ae37-82937d12179a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.179115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.179184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.179357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.179701] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.179701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.179701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.179893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.179982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.180122] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec4659b-96ff-48b6-ae37-82937d12179a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.356288] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a43e643f-8b52-4bbf-8dc6-b82fb3363343',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.403393] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.450312] env[66730]: INFO networking_nsxv3.common.synchronization [req-d57382f7-1fa9-4743-bf9d-32746767fafc req-fc03e241-fb72-4db3-8331-e072bf12d99f tempest-MultipleCreateTestJSON-2049163218 tempest-MultipleCreateTestJSON-2049163218-project-member] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 857.450978] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 857.451431] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.451535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.488590] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 857.491477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.683320] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.683476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.683549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.683785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.685214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.685214] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.685214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.685214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.685214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.685214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.685214] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec4659b-96ff-48b6-ae37-82937d12179a is going to be updated. [ 857.724086] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.726827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.726827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.726827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.726827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.736378] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec4659b-96ff-48b6-ae37-82937d12179a in Status: IN_PROGRESS for 2s [ 857.860138] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.860478] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.860478] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.860626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.860701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.860850] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 is going to be created. [ 857.887576] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.887710] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.887783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.892270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.892453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.904898] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 in Status: UNINITIALIZED for 2s [ 857.907514] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.912744] env[66730]: INFO networking_nsxv3.common.synchronization [None req-78881074-24b9-44e3-9943-130dcb924783 None None] Enqueued Resource ID: 6465613e-2021-4768-8f4b-a0d4054bb3ee with Priority: HIGHEST for action port [ 857.912744] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6465613e-2021-4768-8f4b-a0d4054bb3ee with Priority: HIGHEST for action port [ 857.912744] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-6465613e-2021-4768-8f4b-a0d4054bb3ee taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.912744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6465613e-2021-4768-8f4b-a0d4054bb3ee" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.912744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6465613e-2021-4768-8f4b-a0d4054bb3ee" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.912744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6465613e-2021-4768-8f4b-a0d4054bb3ee" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.912744] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6465613e-2021-4768-8f4b-a0d4054bb3ee',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.410574] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.410755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.410879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.411109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.411157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.411283] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 858.414126] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6465613e-2021-4768-8f4b-a0d4054bb3ee [ 858.414300] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.414423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.414487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.414689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.414758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.414854] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6465613e-2021-4768-8f4b-a0d4054bb3ee already deleted. [ 858.414935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6465613e-2021-4768-8f4b-a0d4054bb3ee" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.442392] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.442594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.443611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.443611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.443611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.454659] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 859.749114] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec4659b-96ff-48b6-ae37-82937d12179a in Status: SUCCESS [ 859.749114] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec4659b-96ff-48b6-ae37-82937d12179a deletion is rescheduled due to dependency. [ 859.749114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec4659b-96ff-48b6-ae37-82937d12179a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.917774] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 in Status: SUCCESS [ 859.917774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.917774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.917774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.917774] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.917774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.917774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.917774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.917774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.917774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.917774] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a43e643f-8b52-4bbf-8dc6-b82fb3363343',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.319121] env[66730]: INFO networking_nsxv3.common.synchronization [None req-69a20f87-004c-44e2-bae9-0847ca1c7888 None None] Enqueued Resource ID: d29bcaf2-f0d2-48b8-a586-2dfd17936940 with Priority: HIGHEST for action port [ 860.319121] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d29bcaf2-f0d2-48b8-a586-2dfd17936940 with Priority: HIGHEST for action port [ 860.319121] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d29bcaf2-f0d2-48b8-a586-2dfd17936940 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.319121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d29bcaf2-f0d2-48b8-a586-2dfd17936940" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.319121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d29bcaf2-f0d2-48b8-a586-2dfd17936940" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.319121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d29bcaf2-f0d2-48b8-a586-2dfd17936940" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.319121] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d29bcaf2-f0d2-48b8-a586-2dfd17936940',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.422235] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a43e643f-8b52-4bbf-8dc6-b82fb3363343',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.467075] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 860.467075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.467075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.467075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.467075] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.467075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.467075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.467075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.467075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.467075] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.822804] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d29bcaf2-f0d2-48b8-a586-2dfd17936940 [ 860.823641] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.823641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.823641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.823854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.823854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.823923] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d29bcaf2-f0d2-48b8-a586-2dfd17936940 already deleted. [ 860.824413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d29bcaf2-f0d2-48b8-a586-2dfd17936940" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.924998] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a43e643f-8b52-4bbf-8dc6-b82fb3363343: rpc.has_security_group_logging(os_id): False [ 860.947612] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.947904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.947904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.948202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.948305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.948529] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.948666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.948798] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.949184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.949184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.949184] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 is going to be created. [ 860.969804] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.969804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.970130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.970270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.970439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.971603] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.971603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.971909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.971909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.972027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.972069] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 861.007766] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.008076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.008076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.008290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.008480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.019717] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 861.037043] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.037043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.037043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.037043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.037449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.054642] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 in Status: IN_PROGRESS for 2s [ 861.977645] env[66730]: INFO networking_nsxv3.common.synchronization [req-c66f1291-3d49-4fb7-9256-2ccaa85cb540 req-6f6e89e6-bb29-4380-a902-b7e42f4954ca tempest-MigrationsAdminTest-1802784989 tempest-MigrationsAdminTest-1802784989-project-member] Enqueued Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 861.979591] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 861.979971] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.980258] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.982038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.982038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.982038] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.982038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.982038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.982329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.982329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.982329] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.158409] env[66730]: INFO networking_nsxv3.common.synchronization [None req-98ec65b0-7d5e-463c-9839-29200b5e8452 tempest-AttachVolumeShelveTestJSON-1677719075 tempest-AttachVolumeShelveTestJSON-1677719075-project-member] Enqueued Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_rules [ 862.158409] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_rules [ 862.162326] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.162471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.162539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.162805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.166587] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.269325] env[66730]: INFO networking_nsxv3.common.synchronization [None req-62084ab5-4753-47b3-9e66-6ad64236d101 tempest-AttachVolumeShelveTestJSON-1677719075 tempest-AttachVolumeShelveTestJSON-1677719075-project-member] Enqueued Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_rules [ 862.269325] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_rules [ 862.269616] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.269689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.485185] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.686181] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.686181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.686181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.686181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.686181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.686181] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 already deleted. [ 862.686181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.686497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.686497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.686560] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.987853] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.030783] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 863.031032] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b deletion is rescheduled due to dependency. [ 863.031133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.068362] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 in Status: SUCCESS [ 863.068585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.210926] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.211079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.211237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.212547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.212547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.212547] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 already deleted. [ 863.212547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.489551] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.489734] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.489806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.490104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.490222] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.490334] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 is going to be updated. [ 863.523117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.523270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.523607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.523908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.524082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.537576] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: IN_PROGRESS for 2s [ 865.550149] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: SUCCESS [ 865.550463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.784672] env[66730]: INFO networking_nsxv3.common.synchronization [req-f63bf808-a062-4a18-98f3-42140ae424e7 req-3e485161-11cd-4699-9483-13adf7fc338c tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 866.785804] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 866.785804] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.785804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.786060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.786100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.786259] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.786362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.786422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.789074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.789074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.789074] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.135260] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.135469] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.135591] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.135868] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.137422] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.137422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.137422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.137422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.137422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.137422] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.137422] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.137422] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.137422] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.137819] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.137819] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.137819] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.164192] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.164192] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 867.164192] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.164192] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.164491] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-fd0525d7-e9b4-493d-a1cc-24323f7ae939 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.164674] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-fd0525d7-e9b4-493d-a1cc-24323f7ae939" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.164791] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-fd0525d7-e9b4-493d-a1cc-24323f7ae939" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.165143] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-fd0525d7-e9b4-493d-a1cc-24323f7ae939" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.165276] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd0525d7-e9b4-493d-a1cc-24323f7ae939',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.290806] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.291858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.291964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.292227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.292308] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.292515] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.292621] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.292684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.292842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.292920] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.293025] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 867.321824] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.322489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.322489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.322610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.322748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.333204] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 867.670629] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.670854] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.670979] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.671311] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.671673] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.671673] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port fd0525d7-e9b4-493d-a1cc-24323f7ae939 not found, creating... [ 867.671854] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.672017] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.672136] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.672349] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.672481] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.672767] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.672921] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.674322] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.674600] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.674745] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.674891] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: fd0525d7-e9b4-493d-a1cc-24323f7ae939 is going to be created. [ 867.696784] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.697054] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.697123] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.697495] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.697794] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.698063] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-fd0525d7-e9b4-493d-a1cc-24323f7ae939" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.403082] env[66730]: INFO networking_nsxv3.common.synchronization [req-f63bf808-a062-4a18-98f3-42140ae424e7 req-55db0421-e5c0-4cfd-8230-824b1abd73c4 service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 868.403082] env[66730]: INFO networking_nsxv3.common.synchronization [req-f63bf808-a062-4a18-98f3-42140ae424e7 req-55db0421-e5c0-4cfd-8230-824b1abd73c4 service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 868.403082] env[66730]: INFO networking_nsxv3.common.synchronization [req-f63bf808-a062-4a18-98f3-42140ae424e7 req-55db0421-e5c0-4cfd-8230-824b1abd73c4 service nova] Enqueued Resource ID: fd0525d7-e9b4-493d-a1cc-24323f7ae939 with Priority: HIGHEST for action port [ 868.403082] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 868.403527] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 868.403527] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0525d7-e9b4-493d-a1cc-24323f7ae939 with Priority: HIGHEST for action port [ 868.406678] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.406678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.406678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.406977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.406977] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.409288] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.409288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.409288] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd0525d7-e9b4-493d-a1cc-24323f7ae939 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.409288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd0525d7-e9b4-493d-a1cc-24323f7ae939" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.409288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd0525d7-e9b4-493d-a1cc-24323f7ae939" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.409288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd0525d7-e9b4-493d-a1cc-24323f7ae939" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.409288] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd0525d7-e9b4-493d-a1cc-24323f7ae939',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.652455] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2a3267e-d921-4239-b62d-c718272b1a16 req-18de0d7d-7eae-4951-9b3d-0c64afb793dd tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 with Priority: HIGHEST for action security_group_members [ 868.652825] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2a3267e-d921-4239-b62d-c718272b1a16 req-18de0d7d-7eae-4951-9b3d-0c64afb793dd tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 868.653362] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 with Priority: HIGHEST for action security_group_members [ 868.653362] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 868.653597] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.653790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.653790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.654622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.654797] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.654906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.654970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.655431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.655431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.655431] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d64c90-b6b1-4f52-93c0-e9f59b990f85',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.656674] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.656784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.656853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.657026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.657170] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.657263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.657324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.657469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.657546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.657636] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.703312] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2a3267e-d921-4239-b62d-c718272b1a16 req-18de0d7d-7eae-4951-9b3d-0c64afb793dd tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_rules [ 868.703527] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2a3267e-d921-4239-b62d-c718272b1a16 req-18de0d7d-7eae-4951-9b3d-0c64afb793dd tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 868.703715] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2a3267e-d921-4239-b62d-c718272b1a16 req-18de0d7d-7eae-4951-9b3d-0c64afb793dd tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 with Priority: HIGHEST for action security_group_rules [ 868.703904] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2a3267e-d921-4239-b62d-c718272b1a16 req-18de0d7d-7eae-4951-9b3d-0c64afb793dd tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 with Priority: HIGHEST for action security_group_members [ 868.706023] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2a3267e-d921-4239-b62d-c718272b1a16 req-18de0d7d-7eae-4951-9b3d-0c64afb793dd tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: 71524284-41d7-44a3-acf5-f9ffd0d6214f with Priority: HIGHEST for action port [ 868.707163] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_rules [ 868.710105] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 with Priority: HIGHEST for action security_group_rules [ 868.710277] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71524284-41d7-44a3-acf5-f9ffd0d6214f with Priority: HIGHEST for action port [ 868.710403] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 868.710508] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 with Priority: HIGHEST for action security_group_members [ 868.710824] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.710965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.711098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.711354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.711442] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.713636] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1d64c90-b6b1-4f52-93c0-e9f59b990f85 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.713923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.713923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.714111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.714202] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1d64c90-b6b1-4f52-93c0-e9f59b990f85',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.716638] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-71524284-41d7-44a3-acf5-f9ffd0d6214f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.716761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.716830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.717011] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.717917] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71524284-41d7-44a3-acf5-f9ffd0d6214f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.718355] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.718442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.718632] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.718707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.912203] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.912352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.912565] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd0525d7-e9b4-493d-a1cc-24323f7ae939 with status ACTIVE [ 868.912766] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.912883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.912951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.913181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.913273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.913464] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.913699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.913699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.913819] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.913877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.914072] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.914167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.914226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.914387] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.914464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.914548] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd0525d7-e9b4-493d-a1cc-24323f7ae939 is going to be updated. [ 868.936357] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.936522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.936596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.936773] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.936907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.937085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd0525d7-e9b4-493d-a1cc-24323f7ae939" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.061183] env[66730]: INFO networking_nsxv3.common.synchronization [req-5a7873da-64a9-45db-96d5-aa60db59e5ab req-74308f00-4b32-4cd1-88ed-be3e58e9a880 tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 with Priority: HIGHEST for action security_group_members [ 869.061347] env[66730]: INFO networking_nsxv3.common.synchronization [req-5a7873da-64a9-45db-96d5-aa60db59e5ab req-74308f00-4b32-4cd1-88ed-be3e58e9a880 tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 869.062039] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 with Priority: HIGHEST for action security_group_members [ 869.062206] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 869.062512] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.062623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.062863] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.062954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.115542] env[66730]: INFO networking_nsxv3.common.synchronization [req-5a7873da-64a9-45db-96d5-aa60db59e5ab req-74308f00-4b32-4cd1-88ed-be3e58e9a880 tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_rules [ 869.115894] env[66730]: INFO networking_nsxv3.common.synchronization [req-5a7873da-64a9-45db-96d5-aa60db59e5ab req-74308f00-4b32-4cd1-88ed-be3e58e9a880 tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 869.117057] env[66730]: INFO networking_nsxv3.common.synchronization [req-5a7873da-64a9-45db-96d5-aa60db59e5ab req-74308f00-4b32-4cd1-88ed-be3e58e9a880 tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: 71524284-41d7-44a3-acf5-f9ffd0d6214f with Priority: HIGHEST for action port [ 869.117057] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_rules [ 869.117057] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 869.117442] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71524284-41d7-44a3-acf5-f9ffd0d6214f with Priority: HIGHEST for action port [ 869.117625] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.117733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.117946] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.118063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.118242] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-71524284-41d7-44a3-acf5-f9ffd0d6214f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.118316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.157842] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1d64c90-b6b1-4f52-93c0-e9f59b990f85',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.160380] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.214460] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.214460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.217266] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.217266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.219662] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71524284-41d7-44a3-acf5-f9ffd0d6214f with status ACTIVE [ 869.219956] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.219956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.220228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.220351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.220391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.220676] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.220676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.220821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.220859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.220914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.221691] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.221691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.221691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.221691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.221691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.221691] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71524284-41d7-44a3-acf5-f9ffd0d6214f is going to be updated. [ 869.248039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.248240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.248293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.248532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.248611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.248778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.249358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.249537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.249825] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71524284-41d7-44a3-acf5-f9ffd0d6214f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.345509] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 869.345687] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 869.345838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.346201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.346902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.346902] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.346902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.346902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.347215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.347251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.349410] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.386587] env[66730]: INFO networking_nsxv3.common.synchronization [req-a2d6becb-3b42-4738-8b0e-d37348e94798 req-6c221fed-d4c3-4d31-ae72-cec466b26a64 tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 869.386587] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 869.386587] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.386587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.386587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.386587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.386938] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.386938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.386938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.387084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.387426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.387507] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.661380] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1d64c90-b6b1-4f52-93c0-e9f59b990f85',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.663404] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.752276] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71524284-41d7-44a3-acf5-f9ffd0d6214f with status ACTIVE [ 869.752524] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.752663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.752731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.752951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.753060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.753239] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.753346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.753424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.753589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.753657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.753844] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.753935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.753987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.754145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.754218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.754295] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71524284-41d7-44a3-acf5-f9ffd0d6214f is going to be updated. [ 869.779384] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.779541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.779591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.779800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.779938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.780143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71524284-41d7-44a3-acf5-f9ffd0d6214f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.826267] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.826467] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.826590] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.826860] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.827230] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.827386] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.827501] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.827717] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.827857] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.828070] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.828185] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.828300] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.828407] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.829422] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.829422] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.829422] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.850033] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.875150] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.875150] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.875150] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.875298] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.875541] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-80b9fc06-278f-4220-9b4b-8f22de3e214a taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.875728] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-80b9fc06-278f-4220-9b4b-8f22de3e214a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.875859] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-80b9fc06-278f-4220-9b4b-8f22de3e214a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.876200] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-80b9fc06-278f-4220-9b4b-8f22de3e214a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.876341] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80b9fc06-278f-4220-9b4b-8f22de3e214a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.890483] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.890692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.890744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.890941] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.891044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.891244] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.891373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.891469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.891663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.891748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.891837] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 869.931606] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.931809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.931809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.932262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.932434] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.942454] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 870.164033] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.164214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.164287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.164509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.164617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.164694] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 is going to be created. [ 870.166037] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.166163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.166231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.166400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.166482] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.166571] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb is going to be updated. [ 870.190755] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.190893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.190961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.191182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.191359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.195529] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.195660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.195728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.195958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.196086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.201577] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 in Status: UNINITIALIZED for 2s [ 870.203249] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: IN_PROGRESS for 2s [ 870.352289] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.380023] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.380377] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.380528] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.381310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.381310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.381310] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 80b9fc06-278f-4220-9b4b-8f22de3e214a not found, creating... [ 870.381482] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.381874] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.381874] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.382072] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.382187] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.383458] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.383458] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.383458] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.383458] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.383458] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.383718] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 80b9fc06-278f-4220-9b4b-8f22de3e214a is going to be created. [ 870.405323] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.405553] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.405638] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.406426] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.406836] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.409969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-80b9fc06-278f-4220-9b4b-8f22de3e214a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.857658] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.857658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.857658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.857658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.857658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.857658] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 870.885025] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.885025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.885025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.885025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.885025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.892990] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 871.135943] env[66730]: INFO networking_nsxv3.common.synchronization [req-a2d6becb-3b42-4738-8b0e-d37348e94798 req-44b5fdc4-c680-441b-9668-2fd4dd05336d service nova] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_rules [ 871.135996] env[66730]: INFO networking_nsxv3.common.synchronization [req-a2d6becb-3b42-4738-8b0e-d37348e94798 req-44b5fdc4-c680-441b-9668-2fd4dd05336d service nova] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 871.136286] env[66730]: INFO networking_nsxv3.common.synchronization [req-a2d6becb-3b42-4738-8b0e-d37348e94798 req-44b5fdc4-c680-441b-9668-2fd4dd05336d service nova] Enqueued Resource ID: 80b9fc06-278f-4220-9b4b-8f22de3e214a with Priority: HIGHEST for action port [ 871.136689] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_rules [ 871.136887] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 871.137065] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80b9fc06-278f-4220-9b4b-8f22de3e214a with Priority: HIGHEST for action port [ 871.139164] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.139164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.139164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.139460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.139460] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.142041] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.145159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.145159] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-80b9fc06-278f-4220-9b4b-8f22de3e214a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.145159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80b9fc06-278f-4220-9b4b-8f22de3e214a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.145159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80b9fc06-278f-4220-9b4b-8f22de3e214a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.145159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80b9fc06-278f-4220-9b4b-8f22de3e214a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.145159] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80b9fc06-278f-4220-9b4b-8f22de3e214a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.647457] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.647457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.647457] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80b9fc06-278f-4220-9b4b-8f22de3e214a with status ACTIVE [ 871.647457] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.647457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.647457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.647457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.647457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.647457] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.647457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.647457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.647457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.647457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.647457] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.648213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.648213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.648213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.648213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.648213] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80b9fc06-278f-4220-9b4b-8f22de3e214a is going to be updated. [ 871.671322] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.671460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.671503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.671733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.671868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.672062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80b9fc06-278f-4220-9b4b-8f22de3e214a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.959367] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 871.959367] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 deletion is rescheduled due to dependency. [ 871.959893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.959893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.959893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.960137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.960210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.960268] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.960422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.960497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.960589] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.215087] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: IN_PROGRESS for 4s [ 872.218379] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 in Status: UNINITIALIZED for 4s [ 872.463715] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.903613] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 872.903829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.904504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.904729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.904930] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.905165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.905165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.905359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.905359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.905462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.905534] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.966881] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.407942] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.408497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.408497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.408497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.411554] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.411554] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.411554] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.411554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.411554] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.470648] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.470858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.470919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.471310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.471440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.471550] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 873.540057] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.540057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.540057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.540057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.540057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.551421] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 873.921327] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5330f620-bc9e-4469-a7f3-c664f754a6e9: rpc.has_security_group_logging(os_id): False [ 873.941225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.941487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.941567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.941866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.941984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.942279] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.942464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.942537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.942836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.942836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.943073] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.943195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.943325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.943558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.943672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.943932] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.944072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.944163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.944348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.944460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.944593] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 874.062366] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.062686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.062686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.062737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.063824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.080352] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 874.229032] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 in Status: SUCCESS [ 874.229287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.230059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.230059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.230059] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.230059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.230059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.230300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.230300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.231143] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d64c90-b6b1-4f52-93c0-e9f59b990f85',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.232205] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: SUCCESS [ 874.232466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.234595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.234595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.234595] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.235524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.235524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.235524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.235524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.235524] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.739543] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.740694] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.740844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.740939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.741181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.741302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.741546] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.741678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.741742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.741933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.742046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.742168] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 is going to be deleted. [ 874.778516] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.778516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.778516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.778793] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.778833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.778944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.780476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.780476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.780476] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.780476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.780476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.780476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.780476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.780701] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d64c90-b6b1-4f52-93c0-e9f59b990f85',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.244671] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.283189] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.283361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.283464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.283656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.283750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.283956] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.284071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.284135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.284295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.284373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.284456] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 already deleted. [ 875.284535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.284701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.284845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.284997] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.285101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.285161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.285348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.285532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.285632] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d64c90-b6b1-4f52-93c0-e9f59b990f85',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.563980] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 875.564223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.564432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.564792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.564893] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.564995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.565056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.565206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.565289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.565378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.565464] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.738869] env[66730]: INFO networking_nsxv3.common.synchronization [req-bc886472-9216-4011-9827-2440a2cf7768 req-c06f3083-c601-494f-90e9-d181eda72e45 tempest-ServerRescueTestJSONUnderV235-1817368564 tempest-ServerRescueTestJSONUnderV235-1817368564-project-member] Enqueued Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 875.738869] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb with Priority: HIGHEST for action security_group_members [ 875.738869] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.738869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.748104] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.748261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.748346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.748555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.748648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.748746] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb is going to be updated. [ 875.783487] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.783644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.783742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.784090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.784090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.787778] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.787969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.787969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.788186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.788291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.788464] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.788620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.788620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.788808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.788942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.789060] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 already deleted. [ 875.789106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.789162] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1d64c90-b6b1-4f52-93c0-e9f59b990f85',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.798095] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: IN_PROGRESS for 2s [ 876.071066] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.071066] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.071066] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.071066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.071066] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.071837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.071837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.071837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.072023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.072123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.072308] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.096428] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 876.096595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.291904] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1d64c90-b6b1-4f52-93c0-e9f59b990f85',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.574794] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f152db72-4e1f-4942-b241-530ee83d9bd1: rpc.has_security_group_logging(os_id): False [ 876.596584] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.597068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.597161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.597487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.597653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.598116] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.598262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.598429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.598599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.598771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.599052] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.599224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.599281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.599431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.599500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.599690] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.599791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.599851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.600023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.600119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.600205] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 876.665734] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.665982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.665982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.666170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.666333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.681886] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 876.794057] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1d64c90-b6b1-4f52-93c0-e9f59b990f85: rpc.has_security_group_logging(os_id): False [ 876.813161] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.813303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.813375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.813589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.813679] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.813877] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.813973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.814048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.814200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.814274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.814360] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 is going to be created. [ 876.835970] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c1d64c90-b6b1-4f52-93c0-e9f59b990f85], does not exist path=[/infra/domains/default/groups/c1d64c90-b6b1-4f52-93c0-e9f59b990f85]."\n}' [ 876.836083] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c1d64c90-b6b1-4f52-93c0-e9f59b990f85 [ 876.836209] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 876.874373] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.874463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.874463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.874664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.875614] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.875876] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.875985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.876064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.876237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.876314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.876483] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.876576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.876634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.876771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.876843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.876930] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1d64c90-b6b1-4f52-93c0-e9f59b990f85 is going to be created. [ 876.896401] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c1d64c90-b6b1-4f52-93c0-e9f59b990f85], does not exist path=[/infra/domains/default/groups/c1d64c90-b6b1-4f52-93c0-e9f59b990f85]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c1d64c90-b6b1-4f52-93c0-e9f59b990f85 [ 876.896547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1d64c90-b6b1-4f52-93c0-e9f59b990f85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.897167] env[66730]: Traceback (most recent call last): [ 876.897167] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 876.897167] env[66730]: return func(*args, **kwargs) [ 876.897167] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 876.897167] env[66730]: res.raise_for_status() [ 876.897167] env[66730]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 876.897167] env[66730]: raise HTTPError(http_error_msg, response=self) [ 876.897488] env[66730]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c1d64c90-b6b1-4f52-93c0-e9f59b990f85 [ 876.897488] env[66730]: During handling of the above exception, another exception occurred: [ 876.897488] env[66730]: Traceback (most recent call last): [ 876.897488] env[66730]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 876.897488] env[66730]: listener.cb(fileno) [ 876.897488] env[66730]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 876.897488] env[66730]: result = function(*args, **kwargs) [ 876.897488] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 876.897488] env[66730]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 876.897488] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 876.897488] env[66730]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 876.897488] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 876.897488] env[66730]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 876.897488] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 876.897488] env[66730]: res.raise_for_status() [ 876.897488] env[66730]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 876.897488] env[66730]: raise HTTPError(http_error_msg, response=self) [ 876.897488] env[66730]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c1d64c90-b6b1-4f52-93c0-e9f59b990f85 [ 876.897488] env[66730]: Removing descriptor: 5 [ 877.810848] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: SUCCESS [ 877.811263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.811263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.811460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.811644] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.811766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.811830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.811984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.812084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.812184] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.003013] env[66730]: INFO networking_nsxv3.common.synchronization [req-f5366a06-1a6e-4df7-8332-6a589f4c20aa req-715af684-65da-4c70-b215-d906f5792855 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_members [ 878.003685] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGHEST for action security_group_members [ 878.004498] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.004706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.004801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.005079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.005292] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.005425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.005520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.005866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.006059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.006145] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.314747] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.314947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.315047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.315317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.348361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.348361] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.348361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.348361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.348361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.348361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.348361] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb is going to be updated. [ 878.414377] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.414377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.414377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.414377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.414377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.426783] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: IN_PROGRESS for 2s [ 878.510028] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.510028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.510028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.510028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.544458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.544729] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.544864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.544928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.545142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.545972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.547569] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 is going to be updated. [ 878.580175] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.580328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.580402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.580696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.580842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.591234] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 in Status: IN_PROGRESS for 2s [ 878.698749] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 878.699099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.147812] env[66730]: INFO networking_nsxv3.common.synchronization [req-6eb79569-a02f-44e7-a3eb-7496992192c2 req-ba05bfcb-79d6-4ba5-8db3-cd275e099566 tempest-ServersTestFqdnHostnames-22117533 tempest-ServersTestFqdnHostnames-22117533-project-member] Enqueued Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_members [ 879.148381] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_members [ 879.148686] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11cfe5ac-91a4-4528-906d-a180bf81f5e5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.148808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.148873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.149227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.149443] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.149541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.149541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.149773] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.152251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.153016] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11cfe5ac-91a4-4528-906d-a180bf81f5e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.544550] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-447 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.544891] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-447" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.544891] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-447" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.545262] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-447" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.545465] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.547751] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.547751] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.547751] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.547751] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.548124] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.548291] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.548432] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.549135] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.549135] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.549332] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.549499] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.571099] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.571217] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 879.571380] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.571849] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-447" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.571954] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-5e238edb-4933-4863-a925-32f220cad21b taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.572092] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-5e238edb-4933-4863-a925-32f220cad21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.572217] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-5e238edb-4933-4863-a925-32f220cad21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.572538] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-5e238edb-4933-4863-a925-32f220cad21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.572677] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e238edb-4933-4863-a925-32f220cad21b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.659639] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.659639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.659639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.659639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.659639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.659639] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.659639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.659639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.659639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.659639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.659639] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 already deleted. [ 879.659639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.077357] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.077670] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.077808] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.078107] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.078262] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.078406] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 5e238edb-4933-4863-a925-32f220cad21b not found, creating... [ 880.078664] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.078815] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.078930] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.079217] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.079353] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.079645] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.079798] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.079912] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.080160] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.080306] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.080445] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 5e238edb-4933-4863-a925-32f220cad21b is going to be created. [ 880.102050] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.102285] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.102384] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.102643] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.102860] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.103089] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-5e238edb-4933-4863-a925-32f220cad21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.437052] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: SUCCESS [ 880.437380] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb deletion is rescheduled due to dependency. [ 880.437380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.437511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.437744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.438067] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.438067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.438232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.438265] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.438322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.438417] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.601175] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 in Status: SUCCESS [ 880.601384] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 deletion is rescheduled due to dependency. [ 880.601503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.810260] env[66730]: INFO networking_nsxv3.common.synchronization [req-6eb79569-a02f-44e7-a3eb-7496992192c2 req-731ae876-9554-4065-9021-02ddf2768ff8 service nova] Enqueued Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_rules [ 880.810339] env[66730]: INFO networking_nsxv3.common.synchronization [req-6eb79569-a02f-44e7-a3eb-7496992192c2 req-731ae876-9554-4065-9021-02ddf2768ff8 service nova] Enqueued Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_members [ 880.810470] env[66730]: INFO networking_nsxv3.common.synchronization [req-6eb79569-a02f-44e7-a3eb-7496992192c2 req-731ae876-9554-4065-9021-02ddf2768ff8 service nova] Enqueued Resource ID: 5e238edb-4933-4863-a925-32f220cad21b with Priority: HIGHEST for action port [ 880.811016] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_rules [ 880.811202] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_members [ 880.811245] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e238edb-4933-4863-a925-32f220cad21b with Priority: HIGHEST for action port [ 880.811559] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.811642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.811709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.811905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.811983] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11cfe5ac-91a4-4528-906d-a180bf81f5e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.813308] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11cfe5ac-91a4-4528-906d-a180bf81f5e5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.813399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.813466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.813630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.813775] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.813868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.813930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.814216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.814216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.814289] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11cfe5ac-91a4-4528-906d-a180bf81f5e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.814945] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e238edb-4933-4863-a925-32f220cad21b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.815064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e238edb-4933-4863-a925-32f220cad21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.815132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e238edb-4933-4863-a925-32f220cad21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.815277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e238edb-4933-4863-a925-32f220cad21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.815347] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e238edb-4933-4863-a925-32f220cad21b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.940871] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.941273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.941273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.941383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.941426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.941677] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.941734] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.941766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.941923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.941986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.942097] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb is going to be updated. [ 880.969436] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.969569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.969630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.972083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.972083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.981688] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: IN_PROGRESS for 2s [ 881.313670] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11cfe5ac-91a4-4528-906d-a180bf81f5e5 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.313670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.322374] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11cfe5ac-91a4-4528-906d-a180bf81f5e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.322374] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e238edb-4933-4863-a925-32f220cad21b with status ACTIVE [ 881.322374] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.322374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.322374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.322374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.322374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.322374] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.322374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.322374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.322374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.322374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.322784] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.322784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.322784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.322883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.322883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.323152] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e238edb-4933-4863-a925-32f220cad21b is going to be updated. [ 881.351730] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.351730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.351730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.351990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.352067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.352230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e238edb-4933-4863-a925-32f220cad21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.519242] env[66730]: INFO networking_nsxv3.common.synchronization [None req-bcd73125-8e4a-4996-8324-319fbc90bffa None None] Enqueued Resource ID: 76df9cf2-3b0b-402f-b569-0327f0653f19 with Priority: HIGHEST for action port [ 881.521107] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76df9cf2-3b0b-402f-b569-0327f0653f19 with Priority: HIGHEST for action port [ 881.521529] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-76df9cf2-3b0b-402f-b569-0327f0653f19 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.521717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76df9cf2-3b0b-402f-b569-0327f0653f19" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.521940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76df9cf2-3b0b-402f-b569-0327f0653f19" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.522186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76df9cf2-3b0b-402f-b569-0327f0653f19" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.522643] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76df9cf2-3b0b-402f-b569-0327f0653f19',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.826593] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11cfe5ac-91a4-4528-906d-a180bf81f5e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.918380] env[66730]: INFO networking_nsxv3.common.synchronization [req-be38ee79-4182-4665-92d3-acd56a758d7a req-5816c077-1a52-4d67-8f55-7e152f912b28 tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_members [ 881.919097] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_members [ 881.919237] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5161856-541b-4ad9-a7f2-629e78702077 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.919360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.919427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.919680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.919827] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.919927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.919986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.920182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.920273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.920363] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.025802] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76df9cf2-3b0b-402f-b569-0327f0653f19 [ 882.026200] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.026292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.026446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.026864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.026971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.027100] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76df9cf2-3b0b-402f-b569-0327f0653f19 already deleted. [ 882.027192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76df9cf2-3b0b-402f-b569-0327f0653f19" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.279334] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.279719] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.280028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.280344] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.280634] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.280796] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.280908] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.281262] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.281550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.281800] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.281984] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.282212] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.282440] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.282657] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.283378] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.283378] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.312353] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.312353] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 882.312530] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.313882] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.313882] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-9381c1be-aed6-4afc-a6a0-5b531fefa63a taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.313882] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-9381c1be-aed6-4afc-a6a0-5b531fefa63a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.313882] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-9381c1be-aed6-4afc-a6a0-5b531fefa63a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.313882] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-9381c1be-aed6-4afc-a6a0-5b531fefa63a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.313882] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9381c1be-aed6-4afc-a6a0-5b531fefa63a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.329063] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.329251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.329325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.329536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.329623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.329719] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 is going to be created. [ 882.355513] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.355641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.356049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.356259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.356309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.367370] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 in Status: UNINITIALIZED for 2s [ 882.423031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.423186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.423257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.423600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.423600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.423784] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.423868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.424236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.424236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.424236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.424236] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5161856-541b-4ad9-a7f2-629e78702077 already deleted. [ 882.424439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.818296] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.818296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.818296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.818296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.818296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.818296] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 9381c1be-aed6-4afc-a6a0-5b531fefa63a not found, creating... [ 882.818296] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.818296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.818296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.818296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.818296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.818899] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.818899] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.818899] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.818899] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.819069] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.819687] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 9381c1be-aed6-4afc-a6a0-5b531fefa63a is going to be created. [ 882.844120] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.844362] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.844480] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.844764] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.845053] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.845292] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-9381c1be-aed6-4afc-a6a0-5b531fefa63a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.996397] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: SUCCESS [ 882.996397] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb deletion is rescheduled due to dependency. [ 882.996397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.996614] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.996778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.996992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.997133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.997197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.997361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.997442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.997559] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.997619] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.003345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.003345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.003517] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.003517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.003594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.003904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.003904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.003904] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.505785] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.505946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.510611] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.510761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.510987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.511694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.511694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.511694] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.511694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.511694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.511694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.512159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.512159] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb is going to be updated. [ 883.543217] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.543217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.543217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.543217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.543217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.553066] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: IN_PROGRESS for 2s [ 883.571186] env[66730]: INFO networking_nsxv3.common.synchronization [req-be38ee79-4182-4665-92d3-acd56a758d7a req-e2c0643c-87fc-4937-bac3-3771efad21ba service nova] Enqueued Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_rules [ 883.571428] env[66730]: INFO networking_nsxv3.common.synchronization [req-be38ee79-4182-4665-92d3-acd56a758d7a req-e2c0643c-87fc-4937-bac3-3771efad21ba service nova] Enqueued Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_members [ 883.571637] env[66730]: INFO networking_nsxv3.common.synchronization [req-be38ee79-4182-4665-92d3-acd56a758d7a req-e2c0643c-87fc-4937-bac3-3771efad21ba service nova] Enqueued Resource ID: 9381c1be-aed6-4afc-a6a0-5b531fefa63a with Priority: HIGHEST for action port [ 883.572270] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_rules [ 883.572436] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_members [ 883.572555] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9381c1be-aed6-4afc-a6a0-5b531fefa63a with Priority: HIGHEST for action port [ 883.573228] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5161856-541b-4ad9-a7f2-629e78702077 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.573436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.575410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.575702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.575815] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.577220] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5161856-541b-4ad9-a7f2-629e78702077 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.577371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.577460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.577688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.577884] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.578012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.578240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.580253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.580253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.580253] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.580992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9381c1be-aed6-4afc-a6a0-5b531fefa63a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.581188] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9381c1be-aed6-4afc-a6a0-5b531fefa63a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.581280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9381c1be-aed6-4afc-a6a0-5b531fefa63a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.581487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9381c1be-aed6-4afc-a6a0-5b531fefa63a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.581587] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9381c1be-aed6-4afc-a6a0-5b531fefa63a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.009293] env[66730]: INFO networking_nsxv3.common.synchronization [None req-e2c88a1a-9ce5-47b4-82db-cc93ec641b0f None None] Enqueued Resource ID: ca6c925c-38b1-4f1c-824a-09e80ac38a56 with Priority: HIGHEST for action port [ 884.012042] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6c925c-38b1-4f1c-824a-09e80ac38a56 with Priority: HIGHEST for action port [ 884.012042] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca6c925c-38b1-4f1c-824a-09e80ac38a56 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.012485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca6c925c-38b1-4f1c-824a-09e80ac38a56" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.012485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca6c925c-38b1-4f1c-824a-09e80ac38a56" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.013109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca6c925c-38b1-4f1c-824a-09e80ac38a56" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.013109] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca6c925c-38b1-4f1c-824a-09e80ac38a56',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.085238] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.089341] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5161856-541b-4ad9-a7f2-629e78702077 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.089341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.089341] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9381c1be-aed6-4afc-a6a0-5b531fefa63a with status ACTIVE [ 884.089341] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.089341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.089341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.089341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.089341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.089341] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.089341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.089341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.089341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.089341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.089956] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.089956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.089956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.089956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.089956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.090125] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9381c1be-aed6-4afc-a6a0-5b531fefa63a is going to be updated. [ 884.119274] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.119541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.119541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.119730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.119835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.119984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9381c1be-aed6-4afc-a6a0-5b531fefa63a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.378897] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 in Status: SUCCESS [ 884.379186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.379371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.379608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.379823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.379968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.380078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.380282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.380366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.380455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.380558] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11cfe5ac-91a4-4528-906d-a180bf81f5e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.517850] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca6c925c-38b1-4f1c-824a-09e80ac38a56 [ 884.517850] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.517850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.517850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.517850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.517850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.517850] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca6c925c-38b1-4f1c-824a-09e80ac38a56 already deleted. [ 884.517850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca6c925c-38b1-4f1c-824a-09e80ac38a56" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.593108] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.882579] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11cfe5ac-91a4-4528-906d-a180bf81f5e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.096489] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.096849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.096849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.097032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.097149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.097272] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5161856-541b-4ad9-a7f2-629e78702077 is going to be created. [ 885.122709] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.122840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.122877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.123103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.123277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.133256] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5161856-541b-4ad9-a7f2-629e78702077 in Status: UNINITIALIZED for 2s [ 885.385279] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11cfe5ac-91a4-4528-906d-a180bf81f5e5: rpc.has_security_group_logging(os_id): False [ 885.417017] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.417017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.417017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.417017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.417017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.417017] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.417017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.417017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.417017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.417017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.417017] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 is going to be created. [ 885.483729] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.483956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.484058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.484362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.484566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.508482] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 in Status: IN_PROGRESS for 2s [ 885.568389] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: SUCCESS [ 885.568626] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb deletion is rescheduled due to dependency. [ 885.568769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.569022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.569311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.569786] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.569786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.569786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.570021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.570063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.570146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.570391] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa65d2d6-1889-401d-bf49-e6a36e79acbb taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.570448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.570545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.570669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.570823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.570939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.571011] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.571155] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.571241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.571358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.571433] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.022623] env[66730]: INFO networking_nsxv3.common.synchronization [req-5900cb79-e0ac-4856-9772-0c1a0d0657f5 req-aa2f1422-839e-447e-8006-ca575ef4063d tempest-ServersAdminTestJSON-1056025790 tempest-ServersAdminTestJSON-1056025790-project-member] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 886.023222] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 886.023535] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.023675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.023805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.024019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.024265] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.024333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.024392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.024672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.024672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.024774] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.074177] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa65d2d6-1889-401d-bf49-e6a36e79acbb: rpc.has_security_group_logging(os_id): False [ 886.098690] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.099369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.099369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.099369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.100074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.100693] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.100897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.101043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.101251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.101482] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.101710] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.101822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.101892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.102054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.102134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.102329] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.102425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.102474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.103086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.103205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.103306] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb is going to be updated. [ 886.173472] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.173603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.173661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.174079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.174240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.189183] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: IN_PROGRESS for 2s [ 886.527301] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.030437] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.144455] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5161856-541b-4ad9-a7f2-629e78702077 in Status: SUCCESS [ 887.144738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.144834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.145059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.145249] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.145364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.145429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.145582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.145660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.145742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.145832] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.521905] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 in Status: SUCCESS [ 887.521905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.532693] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.532875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.532955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.533234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.533350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.533475] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 887.577397] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.577590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.577663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.577834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.578030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.590075] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 887.648302] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.150898] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5161856-541b-4ad9-a7f2-629e78702077: rpc.has_security_group_logging(os_id): False [ 888.169920] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.170179] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.170296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.170526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.170640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.171018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.171896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.171896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.171896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.171896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.171896] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5161856-541b-4ad9-a7f2-629e78702077 is going to be created. [ 888.202769] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb in Status: SUCCESS [ 888.203129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.205101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.205101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.205101] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa65d2d6-1889-401d-bf49-e6a36e79acbb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.248950] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.248950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.248950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.248950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.248950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.279732] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5161856-541b-4ad9-a7f2-629e78702077 in Status: IN_PROGRESS for 2s [ 888.727575] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.727882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.727882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.728206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.728363] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.728609] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa65d2d6-1889-401d-bf49-e6a36e79acbb is going to be deleted. [ 888.794839] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.795178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.795337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.795630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.795804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.796018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa65d2d6-1889-401d-bf49-e6a36e79acbb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.341689] env[66730]: INFO networking_nsxv3.common.synchronization [req-e62cb946-5e6f-455b-b5e3-5efd1b248a64 req-299d8274-2233-4747-841e-50091d71e0ec tempest-ServersWithSpecificFlavorTestJSON-740738296 tempest-ServersWithSpecificFlavorTestJSON-740738296-project-member] Enqueued Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 889.342406] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a144e600-f0ab-4527-b46f-661bc4067c25 with Priority: HIGHEST for action security_group_members [ 889.342781] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a144e600-f0ab-4527-b46f-661bc4067c25 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.342979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.343088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.343336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.343547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.343702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.343806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.344009] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.344225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.344381] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a144e600-f0ab-4527-b46f-661bc4067c25',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.607263] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 889.607519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.849221] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.849372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.849452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.849706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.987496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.987816] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.988128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.988128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.988251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.988328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.988415] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 is going to be updated. [ 890.019495] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.019913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.020143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.020462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.020697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.034412] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: IN_PROGRESS for 2s [ 890.294012] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5161856-541b-4ad9-a7f2-629e78702077 in Status: SUCCESS [ 890.294444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.461033] env[66730]: INFO networking_nsxv3.common.synchronization [req-69c7488f-e2dd-40b4-b7f8-aab409e78378 req-bc5dde31-f81a-4716-9c2a-ad137332da30 tempest-ImagesTestJSON-681326034 tempest-ImagesTestJSON-681326034-project-member] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 890.461505] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 890.461833] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.461996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.462045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.463048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.463238] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.463340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.463404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.463599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.463692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.463786] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.966571] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.966732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.966802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.967089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.967191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.967396] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.967496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.967558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.967718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.967794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.967880] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 already deleted. [ 890.967968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.984029] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-777 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.984233] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.984851] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.984851] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.985010] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.985635] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.985703] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.986067] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.986765] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.986765] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.986765] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.986765] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.986765] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.986948] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.986948] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.987105] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.012162] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.012422] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 891.012642] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.012915] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.013438] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-069eac26-6b54-4676-a102-d67c31a468e7 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.013790] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-069eac26-6b54-4676-a102-d67c31a468e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.013968] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-069eac26-6b54-4676-a102-d67c31a468e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.014454] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-069eac26-6b54-4676-a102-d67c31a468e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.014684] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('069eac26-6b54-4676-a102-d67c31a468e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.517631] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.518049] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.518049] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.518350] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.518540] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.518712] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 069eac26-6b54-4676-a102-d67c31a468e7 not found, creating... [ 891.518917] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.519108] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.519265] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.519509] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.519680] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.519951] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.520150] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.520296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.520530] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.520672] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.520813] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 069eac26-6b54-4676-a102-d67c31a468e7 is going to be created. [ 891.541375] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.541568] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.541713] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.542037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.542323] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.542584] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-069eac26-6b54-4676-a102-d67c31a468e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.046248] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a144e600-f0ab-4527-b46f-661bc4067c25 in Status: SUCCESS [ 892.046429] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a144e600-f0ab-4527-b46f-661bc4067c25 deletion is rescheduled due to dependency. [ 892.046545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a144e600-f0ab-4527-b46f-661bc4067c25" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.257918] env[66730]: INFO networking_nsxv3.common.synchronization [req-69c7488f-e2dd-40b4-b7f8-aab409e78378 req-dba1bb98-eb8d-4e8e-8b4c-2ddd51f00d53 service nova] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_rules [ 892.258102] env[66730]: INFO networking_nsxv3.common.synchronization [req-69c7488f-e2dd-40b4-b7f8-aab409e78378 req-dba1bb98-eb8d-4e8e-8b4c-2ddd51f00d53 service nova] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 892.258299] env[66730]: INFO networking_nsxv3.common.synchronization [req-69c7488f-e2dd-40b4-b7f8-aab409e78378 req-dba1bb98-eb8d-4e8e-8b4c-2ddd51f00d53 service nova] Enqueued Resource ID: 069eac26-6b54-4676-a102-d67c31a468e7 with Priority: HIGHEST for action port [ 892.258760] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_rules [ 892.258896] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 892.258993] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 069eac26-6b54-4676-a102-d67c31a468e7 with Priority: HIGHEST for action port [ 892.259359] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.259425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.259499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.259742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.259828] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.260700] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.260813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.260882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.261056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.261331] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.261331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.261420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.261568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.261664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.261739] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.263424] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-069eac26-6b54-4676-a102-d67c31a468e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.263530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-069eac26-6b54-4676-a102-d67c31a468e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.263578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-069eac26-6b54-4676-a102-d67c31a468e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.263730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-069eac26-6b54-4676-a102-d67c31a468e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.263819] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('069eac26-6b54-4676-a102-d67c31a468e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.741839] env[66730]: INFO networking_nsxv3.common.synchronization [None req-65f290d2-1575-49d8-be11-313ed1f34785 None None] Enqueued Resource ID: eed9b52d-b4f2-4ac2-b358-4bddac369267 with Priority: HIGHEST for action port [ 892.743115] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed9b52d-b4f2-4ac2-b358-4bddac369267 with Priority: HIGHEST for action port [ 892.743115] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-eed9b52d-b4f2-4ac2-b358-4bddac369267 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.743115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eed9b52d-b4f2-4ac2-b358-4bddac369267" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.743115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eed9b52d-b4f2-4ac2-b358-4bddac369267" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.743460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eed9b52d-b4f2-4ac2-b358-4bddac369267" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.743460] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eed9b52d-b4f2-4ac2-b358-4bddac369267',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.768853] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.769516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.769752] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 069eac26-6b54-4676-a102-d67c31a468e7 with status ACTIVE [ 892.769930] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.770056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.770129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.770359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.770438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.770608] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.772803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.772803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.772803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.772803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.772803] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.772803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.772803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.772803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.772803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.772803] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 069eac26-6b54-4676-a102-d67c31a468e7 is going to be updated. [ 892.773770] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.796619] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.796801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.796864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.797302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.797493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.797669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-069eac26-6b54-4676-a102-d67c31a468e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.247582] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eed9b52d-b4f2-4ac2-b358-4bddac369267 [ 893.248021] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.248021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.248163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.249940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.249940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.249940] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eed9b52d-b4f2-4ac2-b358-4bddac369267 already deleted. [ 893.249940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eed9b52d-b4f2-4ac2-b358-4bddac369267" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.276092] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.445046] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.445046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.445046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.445046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.445442] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.445791] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.446039] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.446499] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.446751] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.447060] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.447349] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.447581] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.449054] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.449054] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.449054] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.449054] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.476218] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.476493] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 893.476758] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.476993] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-913" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.477418] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-2c9f0934-3b55-44dc-b6ed-1443527c9831 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.477654] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.477809] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.478125] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.478314] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c9f0934-3b55-44dc-b6ed-1443527c9831',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.779820] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.780236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.780236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.782142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.782142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.782142] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be created. [ 893.809236] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.809236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.809236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.810441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.810489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.822488] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: UNINITIALIZED for 2s [ 893.981375] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.981601] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.981601] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.981890] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.982051] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.982444] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.982566] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.982659] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.982882] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.983041] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.983400] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.983559] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.983674] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.983884] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.984325] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.984509] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 2c9f0934-3b55-44dc-b6ed-1443527c9831 is going to be updated. [ 894.010816] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.011049] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.011238] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.011649] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.011776] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.012025] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.881915] env[66730]: INFO networking_nsxv3.common.synchronization [req-d482edc0-28c1-44a7-9832-08f75cac371e req-132f7897-fe4b-4c96-ae75-e172facc9abc service nova] Enqueued Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_rules [ 894.882204] env[66730]: INFO networking_nsxv3.common.synchronization [req-d482edc0-28c1-44a7-9832-08f75cac371e req-132f7897-fe4b-4c96-ae75-e172facc9abc service nova] Enqueued Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 894.882237] env[66730]: INFO networking_nsxv3.common.synchronization [req-d482edc0-28c1-44a7-9832-08f75cac371e req-132f7897-fe4b-4c96-ae75-e172facc9abc service nova] Enqueued Resource ID: 2c9f0934-3b55-44dc-b6ed-1443527c9831 with Priority: HIGHEST for action port [ 894.882474] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_rules [ 894.882620] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 894.882719] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c9f0934-3b55-44dc-b6ed-1443527c9831 with Priority: HIGHEST for action port [ 894.886823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.887033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.887079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.887307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.887390] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.888358] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.888421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.888504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.888708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.888819] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.888911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.888972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.889170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.889273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.889381] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.891611] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c9f0934-3b55-44dc-b6ed-1443527c9831 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.891739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.891806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.892290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.892392] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c9f0934-3b55-44dc-b6ed-1443527c9831',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.060221] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7c4714fe-9579-43e8-97fa-9d3f6a6046ef None None] Enqueued Resource ID: 519437a0-b118-461c-b157-94442c7ca3c5 with Priority: HIGHEST for action port [ 895.060841] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 519437a0-b118-461c-b157-94442c7ca3c5 with Priority: HIGHEST for action port [ 895.061121] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-519437a0-b118-461c-b157-94442c7ca3c5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.061310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-519437a0-b118-461c-b157-94442c7ca3c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.061310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-519437a0-b118-461c-b157-94442c7ca3c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.061600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-519437a0-b118-461c-b157-94442c7ca3c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.061704] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('519437a0-b118-461c-b157-94442c7ca3c5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.394998] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.394998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.394998] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.395994] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c9f0934-3b55-44dc-b6ed-1443527c9831 with status ACTIVE [ 895.396124] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.396235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.396302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.396550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.396550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.396731] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.396856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.396856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.396984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.397882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.397882] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.397882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.397882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.397882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.397882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.397882] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c9f0934-3b55-44dc-b6ed-1443527c9831 is going to be updated. [ 895.420806] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.421758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.421865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.422108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.422253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.422420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c9f0934-3b55-44dc-b6ed-1443527c9831" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.564803] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 519437a0-b118-461c-b157-94442c7ca3c5 [ 895.566047] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.566047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.566047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.566047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.566395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.566395] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:519437a0-b118-461c-b157-94442c7ca3c5 already deleted. [ 895.566395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-519437a0-b118-461c-b157-94442c7ca3c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.838377] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 895.838377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.838377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.838377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.838377] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.838377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.838377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.839344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.839567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.839739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.839906] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.900158] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.343770] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.343974] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.344026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.344246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.344498] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.344616] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.344652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.344805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.344859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.344969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.345137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.345232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.345295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.345448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.345590] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.345680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.345741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.345878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.345953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.346046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.346166] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.404471] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.404959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.404959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.405222] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.405222] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.405335] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc is going to be updated. [ 896.444256] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.444256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.444256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.446321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.446321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.457710] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: IN_PROGRESS for 2s [ 896.574089] env[66730]: INFO networking_nsxv3.common.synchronization [req-a227b4ee-506f-4615-ba50-cb9b7e40afcb req-e5ecf4c2-ef72-4414-9341-8a5d8fb2c972 tempest-AttachVolumeShelveTestJSON-1677719075 tempest-AttachVolumeShelveTestJSON-1677719075-project-member] Enqueued Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_members [ 896.574628] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_members [ 896.574965] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.575096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.575168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.575422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.575580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.575683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.575738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.575887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.575971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.576075] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.610793] env[66730]: INFO networking_nsxv3.common.synchronization [req-5b9e4a3f-03d5-4c03-8f87-8d13eae1ab02 req-a0e19af4-ea8e-4cf4-b891-dc1d9c78da09 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 896.611273] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 896.611587] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.611698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.611785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.611957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.612400] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.612560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.612644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.612839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.612951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.613082] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.851939] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a7c2214-9790-410b-aab0-021836529ff9: rpc.has_security_group_logging(os_id): False [ 896.874486] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.874658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.874715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.874966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.875080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.875524] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.875524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.875524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.875750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.875797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.875961] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.876794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.876794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.876794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.876794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.876794] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.876794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.876794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.877101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.877227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.877330] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be created. [ 896.948033] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.948033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.948033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.948449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.948706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.961798] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 897.078686] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.078850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.078918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.080190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.080190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.080190] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.080190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.080190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.080190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.080190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.080190] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 already deleted. [ 897.080190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.082537] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.082725] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.082856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.083090] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.083349] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.083501] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.083613] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.084212] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.084212] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.084212] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.084385] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.084441] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.084514] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.084622] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.084729] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.085331] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.108958] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.109362] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 897.109577] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.110015] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.110335] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-f672860b-57b8-4ee0-90d2-fd621c751e75 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.110605] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.110808] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.111237] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.111474] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f672860b-57b8-4ee0-90d2-fd621c751e75',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.117646] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.117812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.117877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.118106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.142284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.142497] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.142618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.142721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.142829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.142915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.143073] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 897.172554] env[66730]: INFO networking_nsxv3.common.synchronization [req-ac3477ce-f7fc-467f-88c1-413bfd118350 req-40852f7a-912f-4dd9-91c9-6284a61f745d tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 897.172978] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 897.173188] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.173310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.173376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.173736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.173736] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.173877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.173877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.174065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.174202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.174259] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.177679] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.177795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.177872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.178148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.178220] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.190853] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 897.613928] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.613928] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.614128] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.614367] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.614514] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.614671] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port f672860b-57b8-4ee0-90d2-fd621c751e75 not found, creating... [ 897.614932] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.615106] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.615223] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.615434] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.615605] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.616014] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.616014] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.616262] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.616501] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.616668] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.616833] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: f672860b-57b8-4ee0-90d2-fd621c751e75 is going to be created. [ 897.649721] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.649915] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.650053] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.650352] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.650575] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.650797] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.676454] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.676649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.676750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.677046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.705034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.705195] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.705268] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.705371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.705583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.705663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.705756] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 897.755236] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.755236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.755236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.755236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.755236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.767810] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 898.266474] env[66730]: INFO networking_nsxv3.common.synchronization [req-04daf0e4-d388-433b-8a46-0383a063d024 req-cc32a62f-050a-4b3f-98e2-f36617e7ced9 tempest-MigrationsAdminTest-1802784989 tempest-MigrationsAdminTest-1802784989-project-member] Enqueued Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 898.269815] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGHEST for action security_group_members [ 898.270835] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.270835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.270835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.271801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.271801] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.271801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.273021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.273320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.273490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.273676] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.371843] env[66730]: INFO networking_nsxv3.common.synchronization [req-a227b4ee-506f-4615-ba50-cb9b7e40afcb req-5d5e0aa1-32c8-4faa-8221-07b4c29a0ea4 service nova] Enqueued Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_rules [ 898.372010] env[66730]: INFO networking_nsxv3.common.synchronization [req-a227b4ee-506f-4615-ba50-cb9b7e40afcb req-5d5e0aa1-32c8-4faa-8221-07b4c29a0ea4 service nova] Enqueued Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_members [ 898.374042] env[66730]: INFO networking_nsxv3.common.synchronization [req-a227b4ee-506f-4615-ba50-cb9b7e40afcb req-5d5e0aa1-32c8-4faa-8221-07b4c29a0ea4 service nova] Enqueued Resource ID: f672860b-57b8-4ee0-90d2-fd621c751e75 with Priority: HIGHEST for action port [ 898.374276] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_rules [ 898.374415] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_members [ 898.374503] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f672860b-57b8-4ee0-90d2-fd621c751e75 with Priority: HIGHEST for action port [ 898.375089] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.375214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.375282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.375544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.375627] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.376494] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.376608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.376676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.376840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.376980] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.377105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.377190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.377338] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.377424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.377510] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.379039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-f672860b-57b8-4ee0-90d2-fd621c751e75 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.379039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.379039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.379039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.379039] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f672860b-57b8-4ee0-90d2-fd621c751e75',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.470150] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: SUCCESS [ 898.470433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.470639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.470889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.471364] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.471764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.471764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.472009] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.472009] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.472143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.472277] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.777711] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.777711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.777711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.777711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.801691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.801959] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.802110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.802172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.802385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.802494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.802589] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 is going to be updated. [ 898.830062] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.830337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.830467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.830708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.830851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.842669] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: IN_PROGRESS for 2s [ 898.880307] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.880465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.880618] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.883193] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f672860b-57b8-4ee0-90d2-fd621c751e75 with status ACTIVE [ 898.883446] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.883596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.883647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.883877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.883973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.884172] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.884355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.884459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.884566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.884627] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.884823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.884927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.884987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.885163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.885534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.885534] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f672860b-57b8-4ee0-90d2-fd621c751e75 is going to be updated. [ 898.909014] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.909268] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.909327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.909971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.909971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.909971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.974290] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 898.974529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.975250] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.975250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.975250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.975463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.975463] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.975588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.975677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.975814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.976327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.976327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.976540] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.976664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.976731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.976878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.977064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.977240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.977240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.977371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.977452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.977535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.977648] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.202018] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 899.202394] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 899.202394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.384100] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.480897] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc: rpc.has_security_group_logging(os_id): False [ 899.503343] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.503491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.503565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.503791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.526596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.527141] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.527333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.527429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.527624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.527977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.527977] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.529137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.529252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.529875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.529875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.529875] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.529875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.529875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.530102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.530135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.530212] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc is going to be updated. [ 899.640455] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.640609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.640701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.640961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.641061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.658230] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: IN_PROGRESS for 2s [ 899.787292] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 899.787422] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 deletion is rescheduled due to dependency. [ 899.787494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.886987] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.887306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.887385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.887622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.887742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.887872] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 is going to be created. [ 899.912323] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.912479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.912522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.912733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.912891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.924629] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: UNINITIALIZED for 2s [ 900.856480] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 in Status: SUCCESS [ 900.857652] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 deletion is rescheduled due to dependency. [ 900.857652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.675924] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: SUCCESS [ 901.675924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.935869] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: SUCCESS [ 901.936263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.936263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.936724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.936724] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.937076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.937076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.937076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.937238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.937283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.937342] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.440477] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.943270] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fdb3ab9-9d8a-4975-a734-c0f1297bd452: rpc.has_security_group_logging(os_id): False [ 902.964852] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.965076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.965167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.965480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.965611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.965993] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.966244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.966332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.966541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.966628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.967284] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 is going to be created. [ 902.979843] env[66730]: INFO networking_nsxv3.common.synchronization [req-0cc89090-d1a3-450c-83ec-8c270271d5e2 req-ad474b01-3954-487f-97e3-99a02330edeb tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 902.981400] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 902.981739] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.981865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.981935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.982221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.982437] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.982583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.982649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.982832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.982922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.983029] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.065565] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.066593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.066593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.066593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.066593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.082033] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: IN_PROGRESS for 2s [ 903.382493] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.382708] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-382" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.382822] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-382" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.384375] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-382" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.386183] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.386183] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.386183] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.386183] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.386183] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.386183] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.386183] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.386183] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.386522] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.386522] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.386522] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.386607] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.408100] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.408357] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 903.408426] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.408577] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-382" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.408967] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.409254] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.409398] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.409733] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.409910] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3464dd1c-4567-4f2e-a712-76fa1cf86bc9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.485390] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.485616] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.485658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.485884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.485993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.486251] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.486365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.486453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.486639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.486736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.490677] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 already deleted. [ 903.490677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.912646] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.912913] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.913137] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.913431] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.913595] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.913758] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 not found, creating... [ 903.914048] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.914268] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.914434] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.914681] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.914828] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.915244] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.915443] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.915742] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.916041] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.916810] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.917089] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 is going to be created. [ 903.940164] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.940510] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.940702] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.940984] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.942250] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.942496] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.665408] env[66730]: INFO networking_nsxv3.common.synchronization [req-0cc89090-d1a3-450c-83ec-8c270271d5e2 req-92477d10-b464-48b5-bbb3-4ac9676228db service nova] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 904.665643] env[66730]: INFO networking_nsxv3.common.synchronization [req-0cc89090-d1a3-450c-83ec-8c270271d5e2 req-92477d10-b464-48b5-bbb3-4ac9676228db service nova] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 904.665718] env[66730]: INFO networking_nsxv3.common.synchronization [req-0cc89090-d1a3-450c-83ec-8c270271d5e2 req-92477d10-b464-48b5-bbb3-4ac9676228db service nova] Enqueued Resource ID: 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 with Priority: HIGHEST for action port [ 904.666672] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 904.666672] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 904.666672] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 with Priority: HIGHEST for action port [ 904.667096] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.667546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.667546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.667546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.667698] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.668548] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.668627] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.668662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.668823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.668972] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.669082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.669156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.669310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.669394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.669485] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.670397] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.670500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.670568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.670822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.670822] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3464dd1c-4567-4f2e-a712-76fa1cf86bc9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.093544] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: SUCCESS [ 905.093794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.157882] env[66730]: INFO networking_nsxv3.common.synchronization [req-158e6657-8486-479e-ab80-059514c41454 req-535b3a36-7f21-4e23-b92c-fbfea53bfe6a tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 905.159022] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 905.159022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.159022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.159022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.160999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.161182] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.161297] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.161364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.163148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.163270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.163376] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.175330] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.175330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.175330] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.175330] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 with status ACTIVE [ 905.175330] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.175330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.175330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.175330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.175330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.175330] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.175330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.175330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.175330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.175330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.175981] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.175981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.175981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.175981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.175981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.175981] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 is going to be updated. [ 905.198583] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.198583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.198583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.198861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.198903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.202147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.479199] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.479433] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.479550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.479805] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.480073] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.480268] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.480384] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.480602] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.480734] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.480948] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.481081] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.481188] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.481325] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.481455] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.481559] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.481688] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.504324] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.504324] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.504324] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.504324] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.504324] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-95d2d58f-e063-4640-b342-e60f1d43b701 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.504787] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-95d2d58f-e063-4640-b342-e60f1d43b701" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.504787] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-95d2d58f-e063-4640-b342-e60f1d43b701" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.504889] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-95d2d58f-e063-4640-b342-e60f1d43b701" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.505012] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95d2d58f-e063-4640-b342-e60f1d43b701',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.665215] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.665395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.665450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.665671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.677305] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.685677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.685927] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.686056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.686124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.686348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.686431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.686525] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 905.716448] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.716448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.716448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.716448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.716448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.727191] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 906.007447] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.007666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.007849] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.008206] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.008365] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.008541] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 95d2d58f-e063-4640-b342-e60f1d43b701 not found, creating... [ 906.008859] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.009034] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.009186] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.009426] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.009568] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.009876] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.010043] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.010173] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.010423] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.010573] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.010715] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 95d2d58f-e063-4640-b342-e60f1d43b701 is going to be created. [ 906.036531] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.036781] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.036912] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.037266] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.037522] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.037870] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-95d2d58f-e063-4640-b342-e60f1d43b701" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.180120] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.180342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.180467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.180853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.181098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.181246] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be created. [ 906.211317] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.211581] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.211581] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.211742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.211949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.223734] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: UNINITIALIZED for 2s [ 906.838783] env[66730]: INFO networking_nsxv3.common.synchronization [req-158e6657-8486-479e-ab80-059514c41454 req-451e8fd4-e2eb-4c77-bb2e-bf7d6bdc1d85 service nova] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_rules [ 906.839108] env[66730]: INFO networking_nsxv3.common.synchronization [req-158e6657-8486-479e-ab80-059514c41454 req-451e8fd4-e2eb-4c77-bb2e-bf7d6bdc1d85 service nova] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 906.839381] env[66730]: INFO networking_nsxv3.common.synchronization [req-158e6657-8486-479e-ab80-059514c41454 req-451e8fd4-e2eb-4c77-bb2e-bf7d6bdc1d85 service nova] Enqueued Resource ID: 95d2d58f-e063-4640-b342-e60f1d43b701 with Priority: HIGHEST for action port [ 906.840078] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_rules [ 906.840270] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 906.840466] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d2d58f-e063-4640-b342-e60f1d43b701 with Priority: HIGHEST for action port [ 906.840726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.840848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.840916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.841167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.841288] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.842471] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.842569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.842855] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-95d2d58f-e063-4640-b342-e60f1d43b701 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.843017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95d2d58f-e063-4640-b342-e60f1d43b701" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.843125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95d2d58f-e063-4640-b342-e60f1d43b701" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.843361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95d2d58f-e063-4640-b342-e60f1d43b701" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.843474] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95d2d58f-e063-4640-b342-e60f1d43b701',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.346259] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.346941] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.346941] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95d2d58f-e063-4640-b342-e60f1d43b701 with status ACTIVE [ 907.346941] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.346941] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.346941] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.347209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.347908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.347908] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.347908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.347908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.347908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.347908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.348179] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.348179] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.348179] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.348356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.348383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.349305] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95d2d58f-e063-4640-b342-e60f1d43b701 is going to be updated. [ 907.376347] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.376347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.376347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.376347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.376347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.376347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95d2d58f-e063-4640-b342-e60f1d43b701" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.604335] env[66730]: INFO networking_nsxv3.common.synchronization [req-307d1c27-865d-4b9b-b4cf-26b9bf9fc206 req-3a933494-abe6-4db0-866e-454107a5b88c tempest-MultipleCreateTestJSON-2049163218 tempest-MultipleCreateTestJSON-2049163218-project-member] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 907.604335] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 907.604335] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.604335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.604335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.604335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.604335] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.604335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.604335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.604335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.604335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.604335] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.739290] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 907.739580] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f deletion is rescheduled due to dependency. [ 907.739783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.739989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.740512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.740776] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.741239] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.741414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.741692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.741796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.741796] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.036576] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.036576] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.036985] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.036985] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.037296] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.037469] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.037590] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.037815] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.037963] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.038190] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.038307] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.038417] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.038528] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.038635] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.038741] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.038875] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.060765] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.060931] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 908.061108] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.061341] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.061677] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-62b29d2c-ad0d-4d89-9564-fd58374e13aa taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.061849] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-62b29d2c-ad0d-4d89-9564-fd58374e13aa" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.061968] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-62b29d2c-ad0d-4d89-9564-fd58374e13aa" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.062318] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-62b29d2c-ad0d-4d89-9564-fd58374e13aa" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.062463] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62b29d2c-ad0d-4d89-9564-fd58374e13aa',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.107743] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.107987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.107987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.108214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.137886] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.138304] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.138955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.139104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.139517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.139662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.139805] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 908.166275] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.166459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.166498] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.167017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.167017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.178900] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 908.237116] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 908.237411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.237685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.238277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.238277] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.238277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.238488] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.238568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.238706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.238853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.238999] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.245183] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.568022] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.568022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.568022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.568022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.568022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.568022] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 62b29d2c-ad0d-4d89-9564-fd58374e13aa not found, creating... [ 908.568022] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.568022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.568022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.568022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.568022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.568582] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.568898] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.569324] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.569697] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.571230] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.571573] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 62b29d2c-ad0d-4d89-9564-fd58374e13aa is going to be created. [ 908.596105] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.596362] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.596505] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.596801] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.597171] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.597521] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-62b29d2c-ad0d-4d89-9564-fd58374e13aa" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.741346] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.741595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.741704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.741981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.742167] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.742322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.742424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.742651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.742775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.742921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.743141] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.743298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.743378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.743602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.743792] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.743938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.744419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.744679] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.744872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.745082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.745257] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.749551] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.248632] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16d1896c-4d80-4a01-9c49-a61403e196c4: rpc.has_security_group_logging(os_id): False [ 909.252804] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.253039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.253210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.253473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.253628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.253779] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 909.278688] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.278847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.278934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.279212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.279297] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.279500] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.279605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.279666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.279826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.279902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.280100] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.280205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.280253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.280403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.280623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.280679] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.280749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.280811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.280947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.283246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.283246] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be created. [ 909.304015] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.304210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.305108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.305108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.305108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.319968] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 909.364395] env[66730]: INFO networking_nsxv3.common.synchronization [req-307d1c27-865d-4b9b-b4cf-26b9bf9fc206 req-92dcba26-3848-4f36-8493-060a83065384 service nova] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_rules [ 909.366469] env[66730]: INFO networking_nsxv3.common.synchronization [req-307d1c27-865d-4b9b-b4cf-26b9bf9fc206 req-92dcba26-3848-4f36-8493-060a83065384 service nova] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 909.366663] env[66730]: INFO networking_nsxv3.common.synchronization [req-307d1c27-865d-4b9b-b4cf-26b9bf9fc206 req-92dcba26-3848-4f36-8493-060a83065384 service nova] Enqueued Resource ID: 62b29d2c-ad0d-4d89-9564-fd58374e13aa with Priority: HIGHEST for action port [ 909.367427] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_rules [ 909.367634] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 909.367781] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b29d2c-ad0d-4d89-9564-fd58374e13aa with Priority: HIGHEST for action port [ 909.368191] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.368340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.368416] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.368589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.368680] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.370922] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.370922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.371094] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-62b29d2c-ad0d-4d89-9564-fd58374e13aa taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.371924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62b29d2c-ad0d-4d89-9564-fd58374e13aa" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.372025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62b29d2c-ad0d-4d89-9564-fd58374e13aa" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.372260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62b29d2c-ad0d-4d89-9564-fd58374e13aa" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.372350] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62b29d2c-ad0d-4d89-9564-fd58374e13aa',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.375744] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.375744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.375744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.375744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.375744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.387865] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 909.429975] env[66730]: INFO networking_nsxv3.common.synchronization [req-8ada6cd8-13f5-4bff-adbb-b7482581a77c req-e7dc3610-8e85-48fc-b66d-9be3c151a2c0 tempest-ServersAdminTestJSON-1056025790 tempest-ServersAdminTestJSON-1056025790-project-member] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 909.430558] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 909.430876] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.431009] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.431145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.431354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.431539] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.431634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.431695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.431837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.431919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.432033] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.874674] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.874849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.877292] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62b29d2c-ad0d-4d89-9564-fd58374e13aa with status ACTIVE [ 909.877491] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.878069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.878236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.878567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.878755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.879052] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.879212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.879279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.879449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.879626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.879906] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.879989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.880031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.880176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.880294] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.880369] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62b29d2c-ad0d-4d89-9564-fd58374e13aa is going to be updated. [ 909.920244] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.920244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.920244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.920509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.920509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.920618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62b29d2c-ad0d-4d89-9564-fd58374e13aa" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.938351] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.193134] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 4s [ 910.208699] env[66730]: INFO networking_nsxv3.common.synchronization [req-307d1c27-865d-4b9b-b4cf-26b9bf9fc206 req-76efbb2c-f96c-47c2-9759-bb5793a8ae31 tempest-MultipleCreateTestJSON-2049163218 tempest-MultipleCreateTestJSON-2049163218-project-member] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 910.209769] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 910.210110] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.210261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.311062] env[66730]: INFO networking_nsxv3.common.synchronization [req-0b50efc2-c288-4b57-a301-63b2aa8e13c0 req-5216a3a1-1e77-4069-8ddd-24766e2578c8 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_members [ 910.311760] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGHEST for action security_group_members [ 910.312102] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.312227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.312293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.312517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.312670] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.312768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.312830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.312981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.313077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.313175] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.440856] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.638373] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.638621] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.638749] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.639054] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.640115] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.640364] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.640511] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.640808] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.640972] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.641258] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.641377] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.641487] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.641607] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.641761] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.641938] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.644487] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.669682] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.669910] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.670066] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.670245] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-307" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.670640] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-1ee8cbeb-ad03-4d55-a549-148ab9efe623 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.670826] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-1ee8cbeb-ad03-4d55-a549-148ab9efe623" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.670948] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-1ee8cbeb-ad03-4d55-a549-148ab9efe623" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.671291] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-1ee8cbeb-ad03-4d55-a549-148ab9efe623" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.671428] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ee8cbeb-ad03-4d55-a549-148ab9efe623',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.817056] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.817056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.817056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.817056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.849497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.849769] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.850656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.850656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.850656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.850656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.850656] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 is going to be updated. [ 910.892832] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.893062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.893062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.893333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.893529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.909024] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 in Status: IN_PROGRESS for 2s [ 910.944455] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.944690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.944690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.944887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.944975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.945097] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 910.981706] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.981917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.981983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.982254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.982408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.000919] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 911.175044] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.175384] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.175594] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.175899] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.176073] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.176245] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 1ee8cbeb-ad03-4d55-a549-148ab9efe623 not found, creating... [ 911.176547] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.176712] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.176828] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.177090] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.177265] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.177573] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.177731] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.177847] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.178155] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.178332] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.178484] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 1ee8cbeb-ad03-4d55-a549-148ab9efe623 is going to be created. [ 911.201831] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.201831] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.201831] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.202193] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.202487] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.202765] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-1ee8cbeb-ad03-4d55-a549-148ab9efe623" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.354260] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 911.354660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.354660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.354889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.355077] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.355203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.355277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.355451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.355590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.355693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.355792] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.410632] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 911.411526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.860509] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.860509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.860509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.860509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.860509] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.860509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.860509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.861051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.861051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.861051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.861482] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.861482] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.861482] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.861704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.862033] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.862196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.862309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.862580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.862741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.862929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.863110] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.004498] env[66730]: INFO networking_nsxv3.common.synchronization [req-307d1c27-865d-4b9b-b4cf-26b9bf9fc206 req-3c509b2e-2c52-4abe-b712-81c47be4fc0e service nova] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_rules [ 912.005813] env[66730]: INFO networking_nsxv3.common.synchronization [req-307d1c27-865d-4b9b-b4cf-26b9bf9fc206 req-3c509b2e-2c52-4abe-b712-81c47be4fc0e service nova] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 912.006629] env[66730]: INFO networking_nsxv3.common.synchronization [req-307d1c27-865d-4b9b-b4cf-26b9bf9fc206 req-3c509b2e-2c52-4abe-b712-81c47be4fc0e service nova] Enqueued Resource ID: 1ee8cbeb-ad03-4d55-a549-148ab9efe623 with Priority: HIGHEST for action port [ 912.008368] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_rules [ 912.008794] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 912.008976] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ee8cbeb-ad03-4d55-a549-148ab9efe623 with Priority: HIGHEST for action port [ 912.009525] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.009692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.010250] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.010250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.011597] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ee8cbeb-ad03-4d55-a549-148ab9efe623 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.012028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ee8cbeb-ad03-4d55-a549-148ab9efe623" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.012028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ee8cbeb-ad03-4d55-a549-148ab9efe623" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.012157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ee8cbeb-ad03-4d55-a549-148ab9efe623" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.012272] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ee8cbeb-ad03-4d55-a549-148ab9efe623',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.209107] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 912.209913] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b deletion is rescheduled due to dependency. [ 912.209913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.209913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.210191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.210394] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.210596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.210596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.210900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.210900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.211081] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.366539] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f: rpc.has_security_group_logging(os_id): False [ 912.390014] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.390171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.390224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.390502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.390660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.391022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.391022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.391185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.391293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.391377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.391728] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.391879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.391943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.393545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.393645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.393876] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.393986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.394075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.394254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.394615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.394615] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 912.464826] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.464966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.465037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.465278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.465559] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.490100] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 912.517447] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ee8cbeb-ad03-4d55-a549-148ab9efe623 with status ACTIVE [ 912.517715] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.517865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.517944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.518185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.518266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.518461] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.518614] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.518681] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.518838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.518917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.519158] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.519336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.519484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.519535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.519624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.519699] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ee8cbeb-ad03-4d55-a549-148ab9efe623 is going to be updated. [ 912.572709] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.572709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.572709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.572709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.572709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.572709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ee8cbeb-ad03-4d55-a549-148ab9efe623" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.714222] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.921471] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 in Status: SUCCESS [ 912.921796] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 deletion is rescheduled due to dependency. [ 912.921909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.013012] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 913.013012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.216535] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.719718] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.720174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.720174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.720334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.722294] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.722416] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 913.785616] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.787019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.787019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.787019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.787019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.808579] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 914.146388] env[66730]: INFO networking_nsxv3.common.synchronization [None req-27b09f45-c664-4c3d-a1a6-6fc0ecf58b79 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 914.147186] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 914.148487] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.148487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.148487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.148487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.148487] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.148487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.148487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.148487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.149015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.149015] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.508064] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 914.508300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.651297] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.958027] env[66730]: INFO networking_nsxv3.common.synchronization [req-d9126447-b732-43db-812a-2b5b5b1133bf req-bb29fab7-efb3-4ee3-a532-0fed32d36d69 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_members [ 914.959020] env[66730]: INFO networking_nsxv3.common.synchronization [req-d9126447-b732-43db-812a-2b5b5b1133bf req-bb29fab7-efb3-4ee3-a532-0fed32d36d69 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 914.959020] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_members [ 914.959020] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 914.959234] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.959365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.959433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.959707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.959859] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.959958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.960033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.960197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.960288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.960406] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.961289] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.961398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.961505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.961633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.961770] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.961867] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.961927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.962084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.962185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.962302] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.010217] env[66730]: INFO networking_nsxv3.common.synchronization [req-d9126447-b732-43db-812a-2b5b5b1133bf req-bb29fab7-efb3-4ee3-a532-0fed32d36d69 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 915.010447] env[66730]: INFO networking_nsxv3.common.synchronization [req-d9126447-b732-43db-812a-2b5b5b1133bf req-bb29fab7-efb3-4ee3-a532-0fed32d36d69 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 915.010595] env[66730]: INFO networking_nsxv3.common.synchronization [req-d9126447-b732-43db-812a-2b5b5b1133bf req-bb29fab7-efb3-4ee3-a532-0fed32d36d69 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_rules [ 915.010748] env[66730]: INFO networking_nsxv3.common.synchronization [req-d9126447-b732-43db-812a-2b5b5b1133bf req-bb29fab7-efb3-4ee3-a532-0fed32d36d69 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_members [ 915.010899] env[66730]: INFO networking_nsxv3.common.synchronization [req-d9126447-b732-43db-812a-2b5b5b1133bf req-bb29fab7-efb3-4ee3-a532-0fed32d36d69 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 with Priority: HIGHEST for action port [ 915.011432] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 915.011634] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_rules [ 915.011766] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 with Priority: HIGHEST for action port [ 915.011859] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 915.011947] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_members [ 915.012243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.012366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.012430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.012639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.012721] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.014230] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a42262f2-f569-4e53-9e7f-cce89b9f6ecb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.014360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.014429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.014697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.014778] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.015608] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.015717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.015785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.015955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.016046] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3464dd1c-4567-4f2e-a712-76fa1cf86bc9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.016788] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.017285] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.017710] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.017802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.154407] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.464080] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.465312] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.518865] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.519070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.519412] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.519550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.519686] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 with status ACTIVE [ 915.519856] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.519999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.520095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.520345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.520432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.520621] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.520742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.520825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.521014] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.521109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.521295] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.521428] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.521558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.521751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.521751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.521851] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 is going to be updated. [ 915.550725] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.551079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.551079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.551496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.551638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.551826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.656531] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.656729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.656786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.657150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.657272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.657380] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 915.698146] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.698430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.698511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.698788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.698969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.713479] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 915.758884] env[66730]: INFO networking_nsxv3.common.synchronization [req-3e0aa6ef-ac26-43ae-8eb7-8f304fa11cc0 req-d9f66c05-9c91-4000-9fd6-eb0572161b08 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 915.759786] env[66730]: INFO networking_nsxv3.common.synchronization [req-3e0aa6ef-ac26-43ae-8eb7-8f304fa11cc0 req-d9f66c05-9c91-4000-9fd6-eb0572161b08 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: b5a2ec48-323c-4685-a7de-26d245ffe466 with Priority: HIGHEST for action security_group_members [ 915.761671] env[66730]: INFO networking_nsxv3.common.synchronization [req-3e0aa6ef-ac26-43ae-8eb7-8f304fa11cc0 req-d9f66c05-9c91-4000-9fd6-eb0572161b08 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_members [ 915.762355] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 915.762546] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a2ec48-323c-4685-a7de-26d245ffe466 with Priority: HIGHEST for action security_group_members [ 915.762610] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_members [ 915.762906] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.763018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.763208] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a2ec48-323c-4685-a7de-26d245ffe466 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.763321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.763401] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.764126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.764126] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.764126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.764126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.764275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.764275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.764327] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.766627] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.766627] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.822570] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 915.822815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.822957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.823645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.823863] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.823987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.824068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.824248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.824337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.824424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.824530] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.825576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.825751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.825917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.826035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.828286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.828469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.828557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.828659] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.835793] env[66730]: INFO networking_nsxv3.common.synchronization [req-3e0aa6ef-ac26-43ae-8eb7-8f304fa11cc0 req-d9f66c05-9c91-4000-9fd6-eb0572161b08 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 915.836522] env[66730]: INFO networking_nsxv3.common.synchronization [req-3e0aa6ef-ac26-43ae-8eb7-8f304fa11cc0 req-d9f66c05-9c91-4000-9fd6-eb0572161b08 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 915.836687] env[66730]: INFO networking_nsxv3.common.synchronization [req-3e0aa6ef-ac26-43ae-8eb7-8f304fa11cc0 req-d9f66c05-9c91-4000-9fd6-eb0572161b08 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_rules [ 915.836817] env[66730]: INFO networking_nsxv3.common.synchronization [req-3e0aa6ef-ac26-43ae-8eb7-8f304fa11cc0 req-d9f66c05-9c91-4000-9fd6-eb0572161b08 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_members [ 915.837026] env[66730]: INFO networking_nsxv3.common.synchronization [req-3e0aa6ef-ac26-43ae-8eb7-8f304fa11cc0 req-d9f66c05-9c91-4000-9fd6-eb0572161b08 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: b5a2ec48-323c-4685-a7de-26d245ffe466 with Priority: HIGHEST for action security_group_rules [ 915.837083] env[66730]: INFO networking_nsxv3.common.synchronization [req-3e0aa6ef-ac26-43ae-8eb7-8f304fa11cc0 req-d9f66c05-9c91-4000-9fd6-eb0572161b08 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: b5a2ec48-323c-4685-a7de-26d245ffe466 with Priority: HIGHEST for action security_group_members [ 915.837256] env[66730]: INFO networking_nsxv3.common.synchronization [req-3e0aa6ef-ac26-43ae-8eb7-8f304fa11cc0 req-d9f66c05-9c91-4000-9fd6-eb0572161b08 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 with Priority: HIGHEST for action port [ 915.837803] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 915.838008] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_rules [ 915.838046] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a2ec48-323c-4685-a7de-26d245ffe466 with Priority: HIGHEST for action security_group_members [ 915.838176] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 with Priority: HIGHEST for action port [ 915.838211] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a2ec48-323c-4685-a7de-26d245ffe466 with Priority: HIGHEST for action security_group_rules [ 915.838394] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 915.838394] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_members [ 915.839183] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.839355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.839587] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a42262f2-f569-4e53-9e7f-cce89b9f6ecb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.839678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.839863] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a2ec48-323c-4685-a7de-26d245ffe466 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.839942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.840158] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.840261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.840326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.840534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.841137] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3464dd1c-4567-4f2e-a712-76fa1cf86bc9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.842525] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5a2ec48-323c-4685-a7de-26d245ffe466 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.842525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.842525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.842525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.842525] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.843403] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.843403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.843830] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.843830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.966234] env[66730]: INFO networking_nsxv3.common.synchronization [req-05fb5644-0d38-450e-82f1-c2ac96f46039 req-186a3af4-1034-475a-a5ad-08b8f3566e48 tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 915.966830] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 915.967664] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.967983] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.969498] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.969631] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.969702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.969954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.970130] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.970255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.970348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.970505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.970606] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.970676] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.267767] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.330638] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.330923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.333830] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.345216] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a2ec48-323c-4685-a7de-26d245ffe466 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.345373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.345698] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 with status ACTIVE [ 916.345943] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.346033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.346096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.346416] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.349187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.349544] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.349879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.349879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.350022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.350116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.350447] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.350601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.350681] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.350852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.350933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.351964] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3464dd1c-4567-4f2e-a712-76fa1cf86bc9 is going to be updated. [ 916.356397] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.356592] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.356716] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.357058] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.357342] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.357519] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.357725] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.357970] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.358116] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.358851] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.359273] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.359432] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.359555] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.359674] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.359804] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.360166] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.379047] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.379047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.379047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.379047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.379047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.379047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3464dd1c-4567-4f2e-a712-76fa1cf86bc9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.382029] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.382308] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 916.382798] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.382798] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.382900] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.383024] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.383153] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.384024] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.384024] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.420746] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.420966] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.421084] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.421387] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.421703] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.421875] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.421986] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.422234] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.422462] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.424409] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.424409] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.424409] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.424409] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.424409] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.424409] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.424409] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.452675] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.452841] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 916.452977] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.453218] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.453566] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-d83f3dba-2f59-48b3-b3c3-013f4d534390 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.453756] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-d83f3dba-2f59-48b3-b3c3-013f4d534390" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.453866] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-d83f3dba-2f59-48b3-b3c3-013f4d534390" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.454488] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-d83f3dba-2f59-48b3-b3c3-013f4d534390" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.454488] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d83f3dba-2f59-48b3-b3c3-013f4d534390',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.472791] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.472950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.473031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.473306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.473406] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.473511] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb is going to be created. [ 916.476698] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.476884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.476934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.477267] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.477378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.477605] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.477714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.477782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.477958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.478060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.478140] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 916.479441] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.479556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.479609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.479771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.479853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.479940] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 916.545705] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.545911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.545911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.546246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.546420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.554967] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.555176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.555176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.555401] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.555539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.567746] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.567978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.567978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.568219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.568378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.570813] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: UNINITIALIZED for 2s [ 916.571479] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 916.579487] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 916.770140] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.836053] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.887041] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.887374] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.887481] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.887752] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.888018] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.888199] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05 not found, creating... [ 916.888533] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.888759] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.888914] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.889196] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.889416] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.889754] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.890040] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.890204] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.890551] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.890744] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.890925] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05 is going to be created. [ 916.914379] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.914725] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.914819] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.915137] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.915605] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.915897] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.957586] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.957818] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.958305] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.958617] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.958772] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.958968] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port d83f3dba-2f59-48b3-b3c3-013f4d534390 not found, creating... [ 916.959398] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.960046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.960046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.960046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.960240] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.960667] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.960836] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.960986] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.961265] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.961444] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.961592] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: d83f3dba-2f59-48b3-b3c3-013f4d534390 is going to be created. [ 917.000565] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.001084] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.001286] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.001628] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.002028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.002423] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-d83f3dba-2f59-48b3-b3c3-013f4d534390" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.272842] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.273106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.273106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.273334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.273475] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.273620] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a2ec48-323c-4685-a7de-26d245ffe466 is going to be created. [ 917.335096] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.335332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.335483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.335884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.336152] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.340586] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.340829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.340829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.340998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.341067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.341187] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 917.351257] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a2ec48-323c-4685-a7de-26d245ffe466 in Status: UNINITIALIZED for 2s [ 917.390780] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.391199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.391298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.391589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.391664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.405281] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 917.674508] env[66730]: INFO networking_nsxv3.common.synchronization [req-05fb5644-0d38-450e-82f1-c2ac96f46039 req-19163e88-81eb-4acf-af4b-4b4a3c544b0c service nova] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_rules [ 917.674508] env[66730]: INFO networking_nsxv3.common.synchronization [req-05fb5644-0d38-450e-82f1-c2ac96f46039 req-19163e88-81eb-4acf-af4b-4b4a3c544b0c service nova] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 917.674630] env[66730]: INFO networking_nsxv3.common.synchronization [req-05fb5644-0d38-450e-82f1-c2ac96f46039 req-19163e88-81eb-4acf-af4b-4b4a3c544b0c service nova] Enqueued Resource ID: 6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05 with Priority: HIGHEST for action port [ 917.675947] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_rules [ 917.676177] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 917.676375] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05 with Priority: HIGHEST for action port [ 917.677034] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.677283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.677394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.678018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.678180] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.679434] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.679581] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.679976] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.679976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.682081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.682081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.682081] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.703175] env[66730]: INFO networking_nsxv3.common.synchronization [req-c3ba7dc2-49fd-4a2d-ab04-3e0c2bd8a472 req-aab7a51d-ad4e-4894-8500-255fb5bd1816 service nova] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_rules [ 917.703379] env[66730]: INFO networking_nsxv3.common.synchronization [req-c3ba7dc2-49fd-4a2d-ab04-3e0c2bd8a472 req-aab7a51d-ad4e-4894-8500-255fb5bd1816 service nova] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 917.703518] env[66730]: INFO networking_nsxv3.common.synchronization [req-c3ba7dc2-49fd-4a2d-ab04-3e0c2bd8a472 req-aab7a51d-ad4e-4894-8500-255fb5bd1816 service nova] Enqueued Resource ID: d83f3dba-2f59-48b3-b3c3-013f4d534390 with Priority: HIGHEST for action port [ 917.705342] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_rules [ 917.705641] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 917.705721] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83f3dba-2f59-48b3-b3c3-013f4d534390 with Priority: HIGHEST for action port [ 917.706143] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.706442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.706536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.706791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.706886] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.710846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.711061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.711491] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d83f3dba-2f59-48b3-b3c3-013f4d534390 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.711687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d83f3dba-2f59-48b3-b3c3-013f4d534390" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.711840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d83f3dba-2f59-48b3-b3c3-013f4d534390" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.712164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d83f3dba-2f59-48b3-b3c3-013f4d534390" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.712324] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d83f3dba-2f59-48b3-b3c3-013f4d534390',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.728469] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 917.728469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.729321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.729996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.729996] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.729996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.730220] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.730311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.730460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.730633] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.183389] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.183389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.183841] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05 with status ACTIVE [ 918.183841] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.183841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.183841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.184184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.184184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.184356] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.184532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.184664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.184790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.185270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.185270] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.185393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.185393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.185713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.185797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.185867] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05 is going to be updated. [ 918.215850] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.215994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.217389] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d83f3dba-2f59-48b3-b3c3-013f4d534390 with status ACTIVE [ 918.217616] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.217744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.217811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.218084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.218138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.218300] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.218397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.218468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.218625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.218701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.218878] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.219090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.219171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.219382] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.219461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.219691] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d83f3dba-2f59-48b3-b3c3-013f4d534390 is going to be updated. [ 918.228324] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.228477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.228549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.228777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.228920] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.229096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e4e00b9-d5cb-4e55-a33e-07b00e1e9a05" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.233160] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.251959] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.252152] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.252253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.252541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.252719] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.252907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d83f3dba-2f59-48b3-b3c3-013f4d534390" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.584119] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 918.584329] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 deletion is rescheduled due to dependency. [ 918.584582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.584821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.585090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.585343] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.585496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.585603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.585803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.585930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.586050] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.587798] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: SUCCESS [ 918.588035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.588674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.588830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.589090] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.589331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.589423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.589596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.589692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.589825] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.593611] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 918.593812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.593976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.594190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.594384] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.594523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.594572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.594730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.594808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.594900] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.736449] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.092447] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.097215] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.098219] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.238654] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.242025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.242025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.242025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.242025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.242025] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 919.319357] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.319573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.319573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.319915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.320029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.334498] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 919.368360] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a2ec48-323c-4685-a7de-26d245ffe466 in Status: SUCCESS [ 919.368360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.368360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.368360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.368360] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.368675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.368675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.368738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.372019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.372019] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.419162] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 919.419473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.419661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.419917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.420132] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.420255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.420329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.420490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.420593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.420711] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.595850] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.600410] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.601190] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.693468] env[66730]: INFO networking_nsxv3.common.synchronization [req-8cdb6dd6-82a0-4341-aa9f-e3f565538141 req-e8783ce8-317f-4073-885e-53b3870a6e0d tempest-ServerGroupTestJSON-157906502 tempest-ServerGroupTestJSON-157906502-project-member] Enqueued Resource ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 with Priority: HIGHEST for action security_group_members [ 919.693847] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 with Priority: HIGHEST for action security_group_members [ 919.694417] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.694417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.694417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.694707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.694931] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.695276] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.695399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.695637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.695733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.696596] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.875535] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.925500] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.101443] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.101443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.101443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.101443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.101443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.101443] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 920.106424] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.106424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.106424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.106424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.106424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.106424] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb is going to be updated. [ 920.107163] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.107457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.107619] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.108439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.108622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.108847] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 920.149838] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.150078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.150078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.151184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.151184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.152989] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.153167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.153334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.153581] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.153581] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.155604] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.155728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.155795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.156064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.156233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.170901] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 920.170901] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: IN_PROGRESS for 2s [ 920.170901] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 920.176308] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.176587] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-923" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.176667] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-923" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.177035] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-923" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.177241] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.177391] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.177512] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.177934] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.178051] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.178200] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.178314] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.178418] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.178515] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.178625] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.178761] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.178841] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.199245] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.199406] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 920.199477] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.199625] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-923" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.200411] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-aa14c23d-36b8-40d2-b5e3-6f273d755c1d taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.200411] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-aa14c23d-36b8-40d2-b5e3-6f273d755c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.200411] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-aa14c23d-36b8-40d2-b5e3-6f273d755c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.200621] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-aa14c23d-36b8-40d2-b5e3-6f273d755c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.200725] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa14c23d-36b8-40d2-b5e3-6f273d755c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.202023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.202023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.202023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.202217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.202217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.202381] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.202594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.202594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.202689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.202878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.202878] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 already deleted. [ 920.202962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.377718] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.430274] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.704040] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.704280] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.704408] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.704716] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.704832] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.704987] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port aa14c23d-36b8-40d2-b5e3-6f273d755c1d not found, creating... [ 920.705294] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.705456] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.705567] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.705786] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.705940] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.706529] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.706771] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.706930] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.707569] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.707780] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.707989] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: aa14c23d-36b8-40d2-b5e3-6f273d755c1d is going to be created. [ 920.738314] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.738314] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.738314] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.738314] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.738314] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.738314] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-aa14c23d-36b8-40d2-b5e3-6f273d755c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.880134] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.880422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.880527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.880830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.880941] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.881094] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a2ec48-323c-4685-a7de-26d245ffe466 is going to be updated. [ 920.932580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.932767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.932830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.933098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.933193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.933365] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 920.936172] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.936359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.936472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.936765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.936983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.966545] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a2ec48-323c-4685-a7de-26d245ffe466 in Status: IN_PROGRESS for 2s [ 921.000648] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.000816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.000816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.001071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.001823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.015102] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 921.350168] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 921.350469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.350665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.350900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.351113] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.351240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.351313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.351476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.351586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.351650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.351743] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.443694] env[66730]: INFO networking_nsxv3.common.synchronization [req-8cdb6dd6-82a0-4341-aa9f-e3f565538141 req-2e3731bc-a676-4adf-854f-77b2d07bb059 service nova] Enqueued Resource ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 with Priority: HIGHEST for action security_group_rules [ 921.443990] env[66730]: INFO networking_nsxv3.common.synchronization [req-8cdb6dd6-82a0-4341-aa9f-e3f565538141 req-2e3731bc-a676-4adf-854f-77b2d07bb059 service nova] Enqueued Resource ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 with Priority: HIGHEST for action security_group_members [ 921.444105] env[66730]: INFO networking_nsxv3.common.synchronization [req-8cdb6dd6-82a0-4341-aa9f-e3f565538141 req-2e3731bc-a676-4adf-854f-77b2d07bb059 service nova] Enqueued Resource ID: aa14c23d-36b8-40d2-b5e3-6f273d755c1d with Priority: HIGHEST for action port [ 921.445404] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 with Priority: HIGHEST for action security_group_rules [ 921.445565] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 with Priority: HIGHEST for action security_group_members [ 921.445783] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa14c23d-36b8-40d2-b5e3-6f273d755c1d with Priority: HIGHEST for action port [ 921.446039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.446169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.446232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.446498] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.446587] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.448118] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.448305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.448305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.448410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.448565] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.448648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.448718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.448850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.448934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.449110] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.451824] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa14c23d-36b8-40d2-b5e3-6f273d755c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.451824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa14c23d-36b8-40d2-b5e3-6f273d755c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.451824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa14c23d-36b8-40d2-b5e3-6f273d755c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.452055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa14c23d-36b8-40d2-b5e3-6f273d755c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.452055] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa14c23d-36b8-40d2-b5e3-6f273d755c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.853715] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.854053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.854133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.854342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.854530] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.854633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.854701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.854854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.854944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.855500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.855500] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.855500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.855500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.855801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.855801] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.855911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.855975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.856145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.856264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.856399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.856621] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.953899] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.954150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.954473] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.955648] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa14c23d-36b8-40d2-b5e3-6f273d755c1d with status ACTIVE [ 921.955894] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.956078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.956157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.956360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.956482] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.956717] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.956863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.956970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.957253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.957350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.957618] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.957747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.957813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.957964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.958054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.958155] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa14c23d-36b8-40d2-b5e3-6f273d755c1d is going to be updated. [ 921.987321] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.987722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.987888] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.988198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.988429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.988812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa14c23d-36b8-40d2-b5e3-6f273d755c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.187355] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: SUCCESS [ 922.187737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.188594] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 922.188831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.192026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.192026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.192026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.192026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.192026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.192026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.192026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.192026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.192026] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.192026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.192026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.192608] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.192608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.192608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.192790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.192921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.193086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.193260] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.195545] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 922.195823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.197049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.197049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.197231] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.197340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.197392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.197553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.197626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.197717] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.198539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.199142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.199142] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.199142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.199142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.199142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.199369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.199369] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.200117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.200321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.200535] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.200648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.200714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.200869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.200956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.201068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.201177] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.359068] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f: rpc.has_security_group_logging(os_id): False [ 922.385137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.385299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.385375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.386528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.386957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.387360] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.387520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.387605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.387810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.387894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.389132] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.389355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.389426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.389619] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.389717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.391050] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.391214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.391284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.391502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.391705] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.391830] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 922.461795] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.486152] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.486792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.486792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.486792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.486792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.507344] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 922.697516] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.702474] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.703486] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.704417] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.704529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.705122] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.705122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.705122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.705122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.705339] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.705385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.705419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.705585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.705668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.705753] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.706269] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.706269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.706269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.706269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.706510] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.706510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.706583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.706822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.706822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.706903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.707014] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.964858] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.965088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.965088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.965338] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.965564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.965564] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 is going to be created. [ 922.986020] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a2ec48-323c-4685-a7de-26d245ffe466 in Status: SUCCESS [ 922.986260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.986442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.986685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.986884] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.987131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.987131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.989895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.989895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.989895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.989895] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.009693] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.009693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.011297] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.011297] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.011297] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.030941] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 in Status: UNINITIALIZED for 2s [ 923.031632] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 923.031851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.032044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.032328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.032565] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.032722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.032804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.033020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.033118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.033213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.033459] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.033583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.033642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.033863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.033977] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.034372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.034492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.034726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.034822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.034900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.035061] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.200276] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a42262f2-f569-4e53-9e7f-cce89b9f6ecb: rpc.has_security_group_logging(os_id): False [ 923.209477] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.211220] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.212575] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f152db72-4e1f-4942-b241-530ee83d9bd1: rpc.has_security_group_logging(os_id): False [ 923.226965] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.228059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.228059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.228059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.228059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.228059] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.228059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.228332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.228551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.228551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.228626] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb is going to be created. [ 923.241476] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.241797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.241797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.242440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.242440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.242440] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.242665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.242665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.242868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.243055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.246144] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.246144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.246144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.246144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.246144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.246585] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.246585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.246585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.246752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.246752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.247657] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 923.401019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.401211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.401299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.401638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.401805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.406739] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.407115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.407115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.407413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.407542] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.423017] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: IN_PROGRESS for 2s [ 923.427461] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 923.492180] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.538446] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 777ab4f0-3fef-4fad-954e-1a3565dcce4b: rpc.has_security_group_logging(os_id): False [ 923.590038] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.590038] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.590038] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.590038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.590726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.590726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.591151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.591499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.591773] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.591989] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 923.713686] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.713856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.713929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.714202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.714323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.714402] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb is going to be updated. [ 923.716011] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.716147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.716208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.716405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.716535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.718291] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 923.751488] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.751488] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.751488] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.751488] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.751488] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.779439] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 923.796768] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.797032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.797032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.797218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.797368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.800025] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.800237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.800334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.800566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.801367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.820575] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 923.821391] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: IN_PROGRESS for 2s [ 923.996490] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5a2ec48-323c-4685-a7de-26d245ffe466: rpc.has_security_group_logging(os_id): False [ 924.019717] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.019992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.020075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.020391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.020499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.020762] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.020960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.021156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.022108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.022108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.022108] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5a2ec48-323c-4685-a7de-26d245ffe466 is going to be created. [ 924.095841] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.097846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.097846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.097846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.097846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.121789] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5a2ec48-323c-4685-a7de-26d245ffe466 in Status: IN_PROGRESS for 2s [ 924.523782] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 924.523782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.044054] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 in Status: SUCCESS [ 925.044054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.044054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.044054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.044054] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.044054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.044054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.044054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.044054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.044054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.044054] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.442112] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: SUCCESS [ 925.442425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.442656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.442934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.443028] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.444924] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 925.445280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.547034] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.547034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.547555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.547555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.547978] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.548158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.548325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.548837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.548837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.548967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.549183] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.549419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.549593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.549786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.550224] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.550684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.550896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.552030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.552030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.552567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.553431] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.802753] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 925.803157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.803413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.803733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.803834] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.835056] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 925.839472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.840639] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: SUCCESS [ 925.840855] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.841389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.841639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.841845] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.841969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.842052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.842213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.842299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.842398] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.843273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.843452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.843632] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.843754] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.843815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.843938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.844043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.845257] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.947026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.947862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.056713] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5: rpc.has_security_group_logging(os_id): False [ 926.086031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.086031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.086031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.086031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.086031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.086031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.086031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.086031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.086031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.086031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.086718] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.086718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.086718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.086718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.086929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.087043] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.087199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.087260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.087589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.087697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.087797] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 is going to be created. [ 926.137302] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5a2ec48-323c-4685-a7de-26d245ffe466 in Status: SUCCESS [ 926.137587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.172421] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.172679] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.172758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.173094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.173175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.205855] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 in Status: IN_PROGRESS for 2s [ 926.306798] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.309726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.309726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.309726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.309726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.309726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.309726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.309726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.309726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.309726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.309726] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.346130] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.347652] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.446547] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 926.446547] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 926.812775] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.813132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.813132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.813348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.813531] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.813638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.813692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.813873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.813991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.814623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.814623] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.814623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.814623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.814893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.815157] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.815275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.815341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.815547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.815618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.815669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.815747] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.849578] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.850919] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.318637] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 777ab4f0-3fef-4fad-954e-1a3565dcce4b: rpc.has_security_group_logging(os_id): False [ 927.338655] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.338868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.338961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.339550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.339731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.339967] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.340135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.340451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.340697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.340784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.341260] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.341388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.341459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.341684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.341770] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.341958] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.342071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.342134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.342280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.342359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.342442] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 927.353659] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.353833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.353906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.354209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.354319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.354424] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 927.355755] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.355880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.355976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.356154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.356154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.356466] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb is going to be updated. [ 927.399526] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.399843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.400568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.400568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.400688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.404553] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.404553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.404553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.404843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.405093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.430674] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: IN_PROGRESS for 2s [ 927.431498] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 927.456798] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.456993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.457086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.457350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.457520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.493447] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 927.700469] env[66730]: INFO networking_nsxv3.common.synchronization [req-ae9afb7c-13d5-41e1-be5e-39654b560281 req-e12ea1c2-f460-4787-8c73-aa0b328664bc tempest-MultipleCreateTestJSON-2049163218 tempest-MultipleCreateTestJSON-2049163218-project-member] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 927.701074] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 927.702243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.702243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.702243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.702243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.702243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.702607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.702684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.702905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.702975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.703074] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.205797] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.222512] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 in Status: SUCCESS [ 928.222512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.402729] env[66730]: INFO networking_nsxv3.common.synchronization [req-ae15dcfd-a92b-4430-88e5-50e652d844ad req-e1dfd7ea-415e-4080-b84b-0737701f10c8 tempest-ImagesTestJSON-681326034 tempest-ImagesTestJSON-681326034-project-member] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 928.402729] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 928.402729] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.402729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.402729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.402729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.402729] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.403058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.403058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.403127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.403331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.403331] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.491791] env[66730]: INFO networking_nsxv3.common.synchronization [req-681017dc-6c8b-46a0-b0b4-a9b380866eb5 req-4d5cdc7d-cbb8-446f-801c-7409677e4fdf tempest-ServersTestFqdnHostnames-22117533 tempest-ServersTestFqdnHostnames-22117533-project-member] Enqueued Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_members [ 928.492487] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 with Priority: HIGHEST for action security_group_members [ 928.492844] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11cfe5ac-91a4-4528-906d-a180bf81f5e5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.492968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.493049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.493364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.493454] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.493555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.493617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.493771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.493865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.493965] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11cfe5ac-91a4-4528-906d-a180bf81f5e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.710134] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.908079] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.909790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.909790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.909790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.909790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.909790] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.909790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.909790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.909790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.909790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.909790] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 928.944741] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.945039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.945039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.945304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.945439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.968454] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 928.996110] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.997204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.997204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.997204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.997204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.997435] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.997609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.997609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.997777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.999084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.999084] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 is going to be updated. [ 929.032641] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.032833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.032960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.033178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.033333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.050115] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 in Status: IN_PROGRESS for 2s [ 929.076311] env[66730]: INFO networking_nsxv3.common.synchronization [req-a820b295-5cf0-4bd8-809f-e8c8499610f2 req-445517dc-a84c-4362-bf59-fe42e5b38029 tempest-MultipleCreateTestJSON-2049163218 tempest-MultipleCreateTestJSON-2049163218-project-member] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 929.077031] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGHEST for action security_group_members [ 929.077211] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.077331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.084048] env[66730]: INFO networking_nsxv3.common.synchronization [req-c1077abf-a92a-40aa-94cd-d3dd4da4a8e9 req-1434e203-dabe-4817-b0e2-81091ba3909d tempest-ServersAdminTestJSON-1056025790 tempest-ServersAdminTestJSON-1056025790-project-member] Enqueued Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 929.084549] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4155358-3708-4cf2-b2a6-fe099ab35896 with Priority: HIGHEST for action security_group_members [ 929.084842] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4155358-3708-4cf2-b2a6-fe099ab35896 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.084959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.085038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.085240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.085396] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.085494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.085554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.085694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.085772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.085861] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4155358-3708-4cf2-b2a6-fe099ab35896',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.212897] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.213285] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.213285] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.213365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.213442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.213537] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 929.259504] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.259654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.259706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.259922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.260077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.284370] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 929.444192] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: SUCCESS [ 929.444192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.444192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.444192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.444192] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.444192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.444414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.444414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.444564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.444600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.445135] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.446494] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 929.447067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.447067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.447172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.448064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.448064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.448064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.448064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.448064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.448064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.448064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.448064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.448745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.448745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.448745] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.448745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.448745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.448745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.448745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.448936] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.448936] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.508810] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 929.508810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.588813] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.588981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.589062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.589342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.612490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.612747] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.612747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.612862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.614026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.614026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.614026] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 is going to be updated. [ 929.644734] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.644921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.644921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.645088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.645602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.657371] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: IN_PROGRESS for 2s [ 929.956334] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.956334] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16d1896c-4d80-4a01-9c49-a61403e196c4: rpc.has_security_group_logging(os_id): False [ 929.976482] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.976669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.976743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.976960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.977069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.977273] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.977365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.977428] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.977590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.977666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.977845] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.977939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.978009] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.978159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.980354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.980354] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.980354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.980354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.980354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.980354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.980354] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 930.047135] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.047290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.047348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.047577] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.047968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.064088] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 930.248219] env[66730]: INFO networking_nsxv3.common.synchronization [None req-1713a181-2c3c-4e90-9ef3-915a969265a1 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_rules [ 930.248860] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_rules [ 930.249099] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.249223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.249333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.249649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.249733] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78eaf9ae-5f5d-4844-9951-fbe27a99cdad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.382543] env[66730]: INFO networking_nsxv3.common.synchronization [None req-c98dc5d0-3083-4f61-8c3a-c77faca3bfc8 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_rules [ 930.383666] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_rules [ 930.383911] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.384550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.459032] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a42262f2-f569-4e53-9e7f-cce89b9f6ecb: rpc.has_security_group_logging(os_id): False [ 930.481039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.481039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.481039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.481039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.481039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.481039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.481039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.481039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.481039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.481039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.481039] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb is going to be updated. [ 930.546999] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.546999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.546999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.546999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.546999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.559415] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: IN_PROGRESS for 2s [ 930.777827] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.777991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.778077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.778308] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.778402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.778500] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad already deleted. [ 930.778597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.778759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.778931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.779055] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78eaf9ae-5f5d-4844-9951-fbe27a99cdad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.978377] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 930.979036] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 deletion is rescheduled due to dependency. [ 930.979036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.060640] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 in Status: SUCCESS [ 931.060852] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11cfe5ac-91a4-4528-906d-a180bf81f5e5 deletion is rescheduled due to dependency. [ 931.060973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11cfe5ac-91a4-4528-906d-a180bf81f5e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.295064] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 931.295311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.295445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.295673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.295908] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.296056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.296056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.296224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.296670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.296670] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.308024] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.308024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.308024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.308024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.308024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.308024] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad already deleted. [ 931.308024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.668116] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4155358-3708-4cf2-b2a6-fe099ab35896 in Status: SUCCESS [ 931.668116] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4155358-3708-4cf2-b2a6-fe099ab35896 deletion is rescheduled due to dependency. [ 931.668116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4155358-3708-4cf2-b2a6-fe099ab35896" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.799887] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.801162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.801297] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.801576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.801703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.801952] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.802227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.802227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.803046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.803176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.803324] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be updated. [ 931.835184] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.835442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.835536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.835840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.836071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.846931] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: IN_PROGRESS for 2s [ 932.077346] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 932.077564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.077775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.078048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.078147] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.394469] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7e18f175-0af2-4054-9051-5b985bf200a2 None None] Enqueued Resource ID: 938beecf-d6af-40e7-90b1-a80ef8c0f49d with Priority: HIGHEST for action port [ 932.394469] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938beecf-d6af-40e7-90b1-a80ef8c0f49d with Priority: HIGHEST for action port [ 932.394469] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-938beecf-d6af-40e7-90b1-a80ef8c0f49d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.394469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-938beecf-d6af-40e7-90b1-a80ef8c0f49d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.394469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-938beecf-d6af-40e7-90b1-a80ef8c0f49d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.394469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-938beecf-d6af-40e7-90b1-a80ef8c0f49d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.394469] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('938beecf-d6af-40e7-90b1-a80ef8c0f49d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.575052] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: SUCCESS [ 932.575305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.580856] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.581054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.581161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.581419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.581634] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.581765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.581855] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.582047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.582163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.582275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.582392] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.898395] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 938beecf-d6af-40e7-90b1-a80ef8c0f49d [ 932.898659] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.898866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.898866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.899108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.899108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.899256] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:938beecf-d6af-40e7-90b1-a80ef8c0f49d already deleted. [ 932.899323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-938beecf-d6af-40e7-90b1-a80ef8c0f49d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.020790] env[66730]: INFO networking_nsxv3.common.synchronization [req-b7018adf-6740-410d-8e88-a86f569b9185 req-8b972280-ade7-4fbc-9dd3-d8a2116db01d tempest-ServerGroupTestJSON-157906502 tempest-ServerGroupTestJSON-157906502-project-member] Enqueued Resource ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 with Priority: HIGHEST for action security_group_members [ 933.021455] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 with Priority: HIGHEST for action security_group_members [ 933.021791] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.021913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.021980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.028203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.028203] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.028203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.028203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.028203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.028203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.028203] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.084215] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.084500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.084500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.084740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.084936] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.085058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.085130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.085292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.085380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.085472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.085617] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.085707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.085764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.085899] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.086045] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.086129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.086186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.086317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.086386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.086508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.086656] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.531031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.531031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.531031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.531031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.531031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.531031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.531031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.531031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.531031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.531031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.531031] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 is going to be updated. [ 933.565090] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.565090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.565090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.565090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.565090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.581349] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 in Status: IN_PROGRESS for 2s [ 933.590142] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16d1896c-4d80-4a01-9c49-a61403e196c4: rpc.has_security_group_logging(os_id): False [ 933.613530] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.613740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.613740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.613880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.613970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.614202] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.614305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.614351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.614544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.614641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.614836] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.614984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.615050] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.615172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.615247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.615484] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.615595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.615658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.615883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.615985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.616201] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 933.780817] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.780979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.781071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.781317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.781494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.797655] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 933.857567] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b in Status: SUCCESS [ 933.857826] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b deletion is rescheduled due to dependency. [ 933.857957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.043210] env[66730]: INFO networking_nsxv3.common.synchronization [req-1542a490-147c-41e3-bcb6-d1414c9d5032 req-53993032-bdae-4c6a-9fbc-7b5504fdbe98 tempest-ImagesTestJSON-681326034 tempest-ImagesTestJSON-681326034-project-member] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 934.043809] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 934.044625] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.044893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.044999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.045264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.045455] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.045608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.045711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.045914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.046046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.046372] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.442664] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-777 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.442871] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.443014] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.443298] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.443559] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.444445] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.444532] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.444797] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.445229] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.445515] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.445670] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.445812] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.445949] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.446099] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.446487] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.446656] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.482046] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.482046] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 934.482046] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.482046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.482046] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-55845061-5d76-4314-9eef-fe13c5183d17 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.482046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-55845061-5d76-4314-9eef-fe13c5183d17" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.482046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-55845061-5d76-4314-9eef-fe13c5183d17" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.482046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-55845061-5d76-4314-9eef-fe13c5183d17" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.482046] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55845061-5d76-4314-9eef-fe13c5183d17',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.552367] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.552645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.552645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.552889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.552986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.553193] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.553295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.553357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.553507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.553587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.553672] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 934.589829] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.589829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.589829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.589829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.589829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.607024] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 934.986068] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.986341] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.986455] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.986714] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.986836] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.986986] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 55845061-5d76-4314-9eef-fe13c5183d17 not found, creating... [ 934.987266] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.987438] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.987525] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.987790] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.987931] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.988270] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.988513] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.988956] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.989212] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.989362] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.989511] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 55845061-5d76-4314-9eef-fe13c5183d17 is going to be created. [ 935.013761] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.013761] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.013761] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.013761] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.013761] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.013761] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-55845061-5d76-4314-9eef-fe13c5183d17" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.037248] env[66730]: INFO networking_nsxv3.common.synchronization [None req-06100fa5-af69-4214-b5d5-2211b4461979 None None] Enqueued Resource ID: 34f2dfbb-5b6f-4731-93b2-f2f3bc514ccf with Priority: HIGHEST for action port [ 935.037866] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34f2dfbb-5b6f-4731-93b2-f2f3bc514ccf with Priority: HIGHEST for action port [ 935.038485] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-34f2dfbb-5b6f-4731-93b2-f2f3bc514ccf taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.038864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34f2dfbb-5b6f-4731-93b2-f2f3bc514ccf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.038864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34f2dfbb-5b6f-4731-93b2-f2f3bc514ccf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.039137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34f2dfbb-5b6f-4731-93b2-f2f3bc514ccf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.039137] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34f2dfbb-5b6f-4731-93b2-f2f3bc514ccf',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.169380] env[66730]: INFO networking_nsxv3.common.synchronization [None req-e79f8d37-d690-447a-8264-dc02f36b2c81 None None] Enqueued Resource ID: 51ecf6a6-d131-4ae7-b2f2-63f43d683cf4 with Priority: HIGHEST for action port [ 935.170071] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51ecf6a6-d131-4ae7-b2f2-63f43d683cf4 with Priority: HIGHEST for action port [ 935.170869] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-51ecf6a6-d131-4ae7-b2f2-63f43d683cf4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.170869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51ecf6a6-d131-4ae7-b2f2-63f43d683cf4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.170869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51ecf6a6-d131-4ae7-b2f2-63f43d683cf4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.170869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51ecf6a6-d131-4ae7-b2f2-63f43d683cf4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.171045] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51ecf6a6-d131-4ae7-b2f2-63f43d683cf4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.543103] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34f2dfbb-5b6f-4731-93b2-f2f3bc514ccf [ 935.543103] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.544283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.547590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.547590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.547590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.547590] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34f2dfbb-5b6f-4731-93b2-f2f3bc514ccf already deleted. [ 935.547590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34f2dfbb-5b6f-4731-93b2-f2f3bc514ccf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.593110] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 in Status: SUCCESS [ 935.593425] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 deletion is rescheduled due to dependency. [ 935.593425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.675070] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51ecf6a6-d131-4ae7-b2f2-63f43d683cf4 [ 935.675070] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.675070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.675070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.675070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.675070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.675070] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51ecf6a6-d131-4ae7-b2f2-63f43d683cf4 already deleted. [ 935.675070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51ecf6a6-d131-4ae7-b2f2-63f43d683cf4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.814383] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 935.814955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.860791] env[66730]: INFO networking_nsxv3.common.synchronization [req-1542a490-147c-41e3-bcb6-d1414c9d5032 req-9179fa18-e1a9-4aa9-804c-3c65ae8b8843 service nova] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_rules [ 935.861069] env[66730]: INFO networking_nsxv3.common.synchronization [req-1542a490-147c-41e3-bcb6-d1414c9d5032 req-9179fa18-e1a9-4aa9-804c-3c65ae8b8843 service nova] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 935.861069] env[66730]: INFO networking_nsxv3.common.synchronization [req-1542a490-147c-41e3-bcb6-d1414c9d5032 req-9179fa18-e1a9-4aa9-804c-3c65ae8b8843 service nova] Enqueued Resource ID: 55845061-5d76-4314-9eef-fe13c5183d17 with Priority: HIGHEST for action port [ 935.862091] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_rules [ 935.862091] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 935.863043] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55845061-5d76-4314-9eef-fe13c5183d17 with Priority: HIGHEST for action port [ 935.864537] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.864537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.864537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.864537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.864537] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.865234] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.865349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.865719] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-55845061-5d76-4314-9eef-fe13c5183d17 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.866039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55845061-5d76-4314-9eef-fe13c5183d17" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.866118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55845061-5d76-4314-9eef-fe13c5183d17" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.866330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55845061-5d76-4314-9eef-fe13c5183d17" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.866406] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55845061-5d76-4314-9eef-fe13c5183d17',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.163738] env[66730]: INFO networking_nsxv3.common.synchronization [req-8f9bace6-206e-41a2-929a-89144aa15378 req-b5564f3a-01f9-47c6-8cea-c39824097c71 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 936.164027] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 936.164311] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.164768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.164768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.164768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.164903] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.164903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.165037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.165495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.165495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.165495] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.372340] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.372340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.372579] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55845061-5d76-4314-9eef-fe13c5183d17 with status ACTIVE [ 936.372929] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.372929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.372929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.373168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.373258] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.373431] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.373529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.373588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.373734] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.373806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.374108] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.374246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.374284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.374404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.374479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.374597] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55845061-5d76-4314-9eef-fe13c5183d17 is going to be updated. [ 936.400815] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.400815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.400815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.401065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.401252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.401295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55845061-5d76-4314-9eef-fe13c5183d17" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.617792] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 936.618171] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 deletion is rescheduled due to dependency. [ 936.618171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.618260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.618598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.618866] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.618987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.619072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.619243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.619353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.619459] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.668249] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.909019] env[66730]: INFO networking_nsxv3.common.synchronization [None req-1bcd481a-3b91-4510-830c-600758db78dc tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 936.909019] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 936.909416] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.909674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.121989] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.172800] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.627491] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.675492] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.675699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.675785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.675993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.676352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.676737] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 937.706223] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.706347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.706488] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.707504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.707504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.717659] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 938.129996] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.130275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.130830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.131131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.131326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.131493] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 938.168200] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.168200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.168200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.168200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.168532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.182148] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 938.286287] env[66730]: INFO networking_nsxv3.common.synchronization [None req-8013bbbe-579a-4c7e-8884-d37a8d803ba1 None None] Enqueued Resource ID: 4b506921-888b-4ee5-b7ab-60887b2dbdca with Priority: HIGHEST for action port [ 938.286287] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b506921-888b-4ee5-b7ab-60887b2dbdca with Priority: HIGHEST for action port [ 938.286287] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b506921-888b-4ee5-b7ab-60887b2dbdca taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.286287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b506921-888b-4ee5-b7ab-60887b2dbdca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.287124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b506921-888b-4ee5-b7ab-60887b2dbdca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.287574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b506921-888b-4ee5-b7ab-60887b2dbdca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.287759] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b506921-888b-4ee5-b7ab-60887b2dbdca',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.790268] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b506921-888b-4ee5-b7ab-60887b2dbdca [ 938.790528] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.790683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.790724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.791689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.791689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.791689] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b506921-888b-4ee5-b7ab-60887b2dbdca already deleted. [ 938.791689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b506921-888b-4ee5-b7ab-60887b2dbdca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.492589] env[66730]: INFO networking_nsxv3.common.synchronization [None req-682c69a0-9a29-4f8d-b9da-7e9f4a17eb61 tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_rules [ 939.493201] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_rules [ 939.493499] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.493663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.493857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.494955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.495066] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.591506] env[66730]: INFO networking_nsxv3.common.synchronization [None req-9eb79bbb-7047-4744-bd8e-1827130cf76b None None] Enqueued Resource ID: 74047c3c-6097-4dcc-ae68-2ec82fcd6275 with Priority: HIGHEST for action port [ 939.592611] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74047c3c-6097-4dcc-ae68-2ec82fcd6275 with Priority: HIGHEST for action port [ 939.592955] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-74047c3c-6097-4dcc-ae68-2ec82fcd6275 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.593119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74047c3c-6097-4dcc-ae68-2ec82fcd6275" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.593313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74047c3c-6097-4dcc-ae68-2ec82fcd6275" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.593545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74047c3c-6097-4dcc-ae68-2ec82fcd6275" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.593652] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74047c3c-6097-4dcc-ae68-2ec82fcd6275',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.673421] env[66730]: INFO networking_nsxv3.common.synchronization [None req-f0a9ff7e-8079-4dd7-92fc-2756be7d303b tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_rules [ 939.673421] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_rules [ 939.673791] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.673791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.729949] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 939.730236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.730787] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.731021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.731216] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.731336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.731396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.731551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.731640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.731773] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.021036] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.021036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.021036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.021036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.021036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.021571] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 already deleted. [ 940.021571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.021571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.021571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.021728] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.097358] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74047c3c-6097-4dcc-ae68-2ec82fcd6275 [ 940.097358] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.097358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.097358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.097832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.098019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.098937] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74047c3c-6097-4dcc-ae68-2ec82fcd6275 already deleted. [ 940.099245] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74047c3c-6097-4dcc-ae68-2ec82fcd6275" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.194864] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 940.194864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.194864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.194864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.195658] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.195658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.195658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.195658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.195892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.195930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.196089] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.234900] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.235102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.235189] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.235431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.235616] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.235795] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.235897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.235947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.236635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.236775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.236890] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 940.271780] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.272058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.272138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.272513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.273108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.283314] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 940.545424] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.545585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.545672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.546829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.546829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.546829] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 already deleted. [ 940.546829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.700061] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.700061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.700061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.700836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.701119] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.701289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.701400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.701613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.701775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.701901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.702102] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.702756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.702756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.702756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.702756] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.702935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.703041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.703410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.703410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.703502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.703604] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.750056] env[66730]: INFO networking_nsxv3.common.synchronization [req-9700ca52-e94a-443a-96f5-e8e2029fdd37 req-b31920bb-c696-4f16-bc1c-117504e414ac tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_members [ 940.750056] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 with Priority: HIGHEST for action security_group_members [ 940.750056] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a43e643f-8b52-4bbf-8dc6-b82fb3363343 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.750316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.750316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.750638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.750638] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.750764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.750764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.751083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.751083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.751153] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a43e643f-8b52-4bbf-8dc6-b82fb3363343',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.207619] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a7c2214-9790-410b-aab0-021836529ff9: rpc.has_security_group_logging(os_id): False [ 941.229595] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.229790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.229790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.229959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.230090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.230293] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.230397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.230460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.230618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.230692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.230875] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.230966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.231037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.231175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.231247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.231440] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.231533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.231592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.231753] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.231828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.232117] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 941.253604] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.253787] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.253787] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.253993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.279236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.279597] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.279751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.279817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.281049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.281049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.281049] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 is going to be updated. [ 941.328050] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.328271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.328313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.328538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.328686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.349808] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.350119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.350274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.352109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.352109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.354370] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 941.361719] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 in Status: IN_PROGRESS for 2s [ 941.847667] env[66730]: INFO networking_nsxv3.common.synchronization [None req-a1edcd0e-154a-4a33-b32d-5a9ae8b5c191 None None] Enqueued Resource ID: ae2f1c84-c84c-46df-bad1-70d1e482ed5d with Priority: HIGHEST for action port [ 941.848263] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae2f1c84-c84c-46df-bad1-70d1e482ed5d with Priority: HIGHEST for action port [ 941.848928] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae2f1c84-c84c-46df-bad1-70d1e482ed5d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.848928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae2f1c84-c84c-46df-bad1-70d1e482ed5d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.848928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae2f1c84-c84c-46df-bad1-70d1e482ed5d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.849492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae2f1c84-c84c-46df-bad1-70d1e482ed5d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.849492] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae2f1c84-c84c-46df-bad1-70d1e482ed5d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.311600] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 942.313307] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f deletion is rescheduled due to dependency. [ 942.313451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.352236] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae2f1c84-c84c-46df-bad1-70d1e482ed5d [ 942.352546] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.352689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.352754] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.353993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.354089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.354187] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae2f1c84-c84c-46df-bad1-70d1e482ed5d already deleted. [ 942.354329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae2f1c84-c84c-46df-bad1-70d1e482ed5d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.605708] env[66730]: INFO networking_nsxv3.common.synchronization [req-6f40dab9-e13f-4bac-9160-d8f3653ea3e5 req-fd20abe8-9726-47e5-95ac-0308c0a28fdb tempest-ServerActionsTestOtherB-1094684457 tempest-ServerActionsTestOtherB-1094684457-project-member] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 942.606280] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 942.606980] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.606980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.606980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.606980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.608366] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.608366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.608522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.608649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.608697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.608768] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.111538] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.111726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.111799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.112013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.138772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.139080] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.139201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.139259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.139494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.139580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.139684] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 943.174031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.174176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.174220] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.174478] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.174609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.186041] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 943.372447] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 943.373099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.373844] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 in Status: SUCCESS [ 943.373905] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a43e643f-8b52-4bbf-8dc6-b82fb3363343 deletion is rescheduled due to dependency. [ 943.374110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a43e643f-8b52-4bbf-8dc6-b82fb3363343" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.199393] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 945.199682] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba deletion is rescheduled due to dependency. [ 945.199758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.606873] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 947.607229] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 947.922370] env[66730]: INFO networking_nsxv3.common.synchronization [None req-137b2114-55db-42e0-9d40-422d73c32e8e None None] Enqueued Resource ID: e9a1d8f4-35e0-49df-bc0a-ce6e8576bad8 with Priority: HIGHEST for action port [ 947.922932] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9a1d8f4-35e0-49df-bc0a-ce6e8576bad8 with Priority: HIGHEST for action port [ 947.923244] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9a1d8f4-35e0-49df-bc0a-ce6e8576bad8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.923385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9a1d8f4-35e0-49df-bc0a-ce6e8576bad8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.925165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9a1d8f4-35e0-49df-bc0a-ce6e8576bad8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.926323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9a1d8f4-35e0-49df-bc0a-ce6e8576bad8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.927467] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9a1d8f4-35e0-49df-bc0a-ce6e8576bad8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.334021] env[66730]: INFO networking_nsxv3.common.synchronization [req-3ed834a5-94c5-47fd-a847-5a67c5f5fab7 req-2d2b0683-aeea-4a99-a412-5b91a537fce3 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 948.336107] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 948.338683] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.338683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.338683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.338683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.338683] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.338683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.338683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.339048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.339048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.339133] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.430368] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9a1d8f4-35e0-49df-bc0a-ce6e8576bad8 [ 948.430546] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.434023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.434023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.434023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.434023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.434023] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9a1d8f4-35e0-49df-bc0a-ce6e8576bad8 already deleted. [ 948.434023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9a1d8f4-35e0-49df-bc0a-ce6e8576bad8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.737372] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.737828] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.737828] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.738220] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.740883] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.741068] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.741197] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.741536] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.741773] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.742079] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.742274] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.742463] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.742675] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.742846] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.743024] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.743251] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.765998] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.766230] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 948.766431] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.766668] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.767189] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-3623ed4c-c1e4-408f-b338-2d14e09be324 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.767354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-3623ed4c-c1e4-408f-b338-2d14e09be324" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.769162] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-3623ed4c-c1e4-408f-b338-2d14e09be324" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.769162] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-3623ed4c-c1e4-408f-b338-2d14e09be324" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.774155] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3623ed4c-c1e4-408f-b338-2d14e09be324',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.841923] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.842097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.842143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.842350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.843028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.843028] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.843028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.843028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.843028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.843272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.843272] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 948.874133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.874347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.874347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.874605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.874708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.885055] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 949.277735] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.277960] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.278202] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.278549] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.278697] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.278858] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 3623ed4c-c1e4-408f-b338-2d14e09be324 not found, creating... [ 949.279156] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.279310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.279466] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.279696] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.279826] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.280127] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.280277] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.280399] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.280638] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.280767] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.281975] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 3623ed4c-c1e4-408f-b338-2d14e09be324 is going to be created. [ 949.308330] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.308594] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.308723] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.308994] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.309236] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.309496] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-3623ed4c-c1e4-408f-b338-2d14e09be324" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.036376] env[66730]: INFO networking_nsxv3.common.synchronization [req-3ed834a5-94c5-47fd-a847-5a67c5f5fab7 req-3845d08e-d25e-47b9-b972-7d32135ae8c6 service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 950.036376] env[66730]: INFO networking_nsxv3.common.synchronization [req-3ed834a5-94c5-47fd-a847-5a67c5f5fab7 req-3845d08e-d25e-47b9-b972-7d32135ae8c6 service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 950.036376] env[66730]: INFO networking_nsxv3.common.synchronization [req-3ed834a5-94c5-47fd-a847-5a67c5f5fab7 req-3845d08e-d25e-47b9-b972-7d32135ae8c6 service nova] Enqueued Resource ID: 3623ed4c-c1e4-408f-b338-2d14e09be324 with Priority: HIGHEST for action port [ 950.036376] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 950.036376] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 950.036376] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3623ed4c-c1e4-408f-b338-2d14e09be324 with Priority: HIGHEST for action port [ 950.036376] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.036376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.036376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.037064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.037064] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.037501] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.037501] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.037747] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3623ed4c-c1e4-408f-b338-2d14e09be324 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.037859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3623ed4c-c1e4-408f-b338-2d14e09be324" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.037859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3623ed4c-c1e4-408f-b338-2d14e09be324" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.038595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3623ed4c-c1e4-408f-b338-2d14e09be324" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.038595] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3623ed4c-c1e4-408f-b338-2d14e09be324',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.250203] env[66730]: INFO networking_nsxv3.common.synchronization [None req-f46c829e-ffa2-4825-ac4c-ea4c53d09a66 None None] Enqueued Resource ID: 71a77786-53d5-4d17-81c2-e401ca94dbb3 with Priority: HIGHEST for action port [ 950.251112] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71a77786-53d5-4d17-81c2-e401ca94dbb3 with Priority: HIGHEST for action port [ 950.251261] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-71a77786-53d5-4d17-81c2-e401ca94dbb3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.251412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71a77786-53d5-4d17-81c2-e401ca94dbb3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.251500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71a77786-53d5-4d17-81c2-e401ca94dbb3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.252501] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71a77786-53d5-4d17-81c2-e401ca94dbb3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.253059] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71a77786-53d5-4d17-81c2-e401ca94dbb3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.418764] env[66730]: INFO networking_nsxv3.common.synchronization [None req-879ee9e9-43ff-4ba9-a76c-190564abd543 None None] Enqueued Resource ID: f9436388-0b62-4bd1-ac1b-69ab40dd4da9 with Priority: HIGHEST for action port [ 950.419330] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9436388-0b62-4bd1-ac1b-69ab40dd4da9 with Priority: HIGHEST for action port [ 950.420476] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9436388-0b62-4bd1-ac1b-69ab40dd4da9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.420476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9436388-0b62-4bd1-ac1b-69ab40dd4da9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.420717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9436388-0b62-4bd1-ac1b-69ab40dd4da9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.421040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9436388-0b62-4bd1-ac1b-69ab40dd4da9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.421040] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9436388-0b62-4bd1-ac1b-69ab40dd4da9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.543537] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.543537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.543537] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3623ed4c-c1e4-408f-b338-2d14e09be324 with status ACTIVE [ 950.543537] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.543537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.543537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.543537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.543537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.543537] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.543537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.543537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.543537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.543537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.543537] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.544269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.544269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.544269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.544269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.544269] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3623ed4c-c1e4-408f-b338-2d14e09be324 is going to be updated. [ 950.567490] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.567490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.567490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.567490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.567490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.567744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3623ed4c-c1e4-408f-b338-2d14e09be324" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.757388] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71a77786-53d5-4d17-81c2-e401ca94dbb3 [ 950.757388] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.757388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.757388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.757388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.757388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.757388] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71a77786-53d5-4d17-81c2-e401ca94dbb3 already deleted. [ 950.757388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71a77786-53d5-4d17-81c2-e401ca94dbb3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.897028] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 950.898501] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 950.898843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.899014] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.899414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.899992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.899992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.899992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.899992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.900255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.900255] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.924486] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9436388-0b62-4bd1-ac1b-69ab40dd4da9 [ 950.924486] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.924486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.924486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.924486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.924486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.924486] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9436388-0b62-4bd1-ac1b-69ab40dd4da9 already deleted. [ 950.924486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9436388-0b62-4bd1-ac1b-69ab40dd4da9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.402389] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.904568] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.015772] env[66730]: INFO networking_nsxv3.common.synchronization [None req-25559227-e345-4f8c-b024-7a32f0647b45 tempest-ServerActionsV293TestJSON-1968079804 tempest-ServerActionsV293TestJSON-1968079804-project-member] Enqueued Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_rules [ 952.016190] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_rules [ 952.016440] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.016580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.016641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.016881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.017144] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.181501] env[66730]: INFO networking_nsxv3.common.synchronization [None req-fe2aedd1-744b-4995-92e4-a9df0f93a3b0 tempest-ServerActionsV293TestJSON-1968079804 tempest-ServerActionsV293TestJSON-1968079804-project-member] Enqueued Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_rules [ 952.186288] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_rules [ 952.186958] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.187072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.408446] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.408841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.408841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.408989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.408989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.409120] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 952.419907] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7d3d473b-0c55-4a53-bd3d-767f84da5877 None None] Enqueued Resource ID: 7aa30826-8f0a-4c5d-9a6b-3925182a5b06 with Priority: HIGHEST for action port [ 952.420521] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa30826-8f0a-4c5d-9a6b-3925182a5b06 with Priority: HIGHEST for action port [ 952.420886] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-7aa30826-8f0a-4c5d-9a6b-3925182a5b06 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.421035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7aa30826-8f0a-4c5d-9a6b-3925182a5b06" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.421097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7aa30826-8f0a-4c5d-9a6b-3925182a5b06" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.421353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7aa30826-8f0a-4c5d-9a6b-3925182a5b06" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.421436] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7aa30826-8f0a-4c5d-9a6b-3925182a5b06',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.459216] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.459216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.459216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.459216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.459216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.468626] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 952.557383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.557851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.557851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.557851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.558532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.558532] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 already deleted. [ 952.558532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.558532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.558532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.558532] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.764428] env[66730]: INFO networking_nsxv3.common.synchronization [req-f013293d-db46-4ef7-be24-81fbbd302284 req-eacbfa05-57ca-43ed-be41-ed9921bc8ae7 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_members [ 952.766948] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_members [ 952.769945] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.770158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.770218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.770459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.770669] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.770780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.770845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.771010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.771100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.771203] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78eaf9ae-5f5d-4844-9951-fbe27a99cdad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.923610] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7aa30826-8f0a-4c5d-9a6b-3925182a5b06 [ 952.923842] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.924169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.924169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.924288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.924504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.924504] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7aa30826-8f0a-4c5d-9a6b-3925182a5b06 already deleted. [ 952.924593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7aa30826-8f0a-4c5d-9a6b-3925182a5b06" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.082541] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.082723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.082812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.083116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.083332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.083332] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 already deleted. [ 953.083432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.258567] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.258567] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.258740] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.259040] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.259396] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.259579] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.260063] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.260378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.261024] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.261024] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.261024] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.261024] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.261024] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.261331] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.261331] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.261448] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.279128] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.279302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.279345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.279654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.279744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.279962] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.280084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.280147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.280306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.280384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.280476] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad already deleted. [ 953.280626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.291935] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.292124] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 953.292264] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.292439] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.292766] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-eda7f553-4a75-4795-8c71-1560c77200bd taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.292942] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-eda7f553-4a75-4795-8c71-1560c77200bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.293103] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-eda7f553-4a75-4795-8c71-1560c77200bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.293560] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-eda7f553-4a75-4795-8c71-1560c77200bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.293711] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eda7f553-4a75-4795-8c71-1560c77200bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.800097] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.800446] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.800487] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.800777] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.800975] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.801174] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port eda7f553-4a75-4795-8c71-1560c77200bd not found, creating... [ 953.801494] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.801680] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.801822] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.802115] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.802276] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.802647] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.802860] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.803014] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.805231] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.805422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.807217] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: eda7f553-4a75-4795-8c71-1560c77200bd is going to be created. [ 953.830172] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.830453] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.830601] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.831366] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.831366] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.831490] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-eda7f553-4a75-4795-8c71-1560c77200bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.509314] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 954.509314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.509314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.509314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.509314] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.509314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.509314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.509314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.509314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.509314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.509314] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.589900] env[66730]: INFO networking_nsxv3.common.synchronization [req-f013293d-db46-4ef7-be24-81fbbd302284 req-d1d33936-fe10-402e-8906-68cebd0f4b25 service nova] Enqueued Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_rules [ 954.589900] env[66730]: INFO networking_nsxv3.common.synchronization [req-f013293d-db46-4ef7-be24-81fbbd302284 req-d1d33936-fe10-402e-8906-68cebd0f4b25 service nova] Enqueued Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_members [ 954.589900] env[66730]: INFO networking_nsxv3.common.synchronization [req-f013293d-db46-4ef7-be24-81fbbd302284 req-d1d33936-fe10-402e-8906-68cebd0f4b25 service nova] Enqueued Resource ID: eda7f553-4a75-4795-8c71-1560c77200bd with Priority: HIGHEST for action port [ 954.589900] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_rules [ 954.589900] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_members [ 954.590495] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda7f553-4a75-4795-8c71-1560c77200bd with Priority: HIGHEST for action port [ 954.590548] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.590708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.590783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.594992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.595126] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78eaf9ae-5f5d-4844-9951-fbe27a99cdad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.596227] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.596368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.596415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.596587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.596746] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.596844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.596908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.598323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.598323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.598323] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78eaf9ae-5f5d-4844-9951-fbe27a99cdad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.600255] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-eda7f553-4a75-4795-8c71-1560c77200bd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.600444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eda7f553-4a75-4795-8c71-1560c77200bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.600444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eda7f553-4a75-4795-8c71-1560c77200bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.600841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eda7f553-4a75-4795-8c71-1560c77200bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.600841] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eda7f553-4a75-4795-8c71-1560c77200bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.013373] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.013715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.014217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.014217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.014393] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.014615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.014615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.014914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.015078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.016086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.016086] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.016086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.016086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.016086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.016086] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.016339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.016339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.016577] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.016674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.016759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.016852] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.099812] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78eaf9ae-5f5d-4844-9951-fbe27a99cdad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.104069] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.104723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.104723] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eda7f553-4a75-4795-8c71-1560c77200bd with status ACTIVE [ 955.104841] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.105269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.105269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.105491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.105526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.105688] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.105786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.105990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.106095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.106095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.106270] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.106360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.106483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.107185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.107185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.107185] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eda7f553-4a75-4795-8c71-1560c77200bd is going to be updated. [ 955.129782] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.129943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.129987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.130219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.130357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.130600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eda7f553-4a75-4795-8c71-1560c77200bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.519916] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5330f620-bc9e-4469-a7f3-c664f754a6e9: rpc.has_security_group_logging(os_id): False [ 955.541906] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.542344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.542549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.542790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.542933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.543227] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.545346] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.545346] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.545346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.545346] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 955.605019] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78eaf9ae-5f5d-4844-9951-fbe27a99cdad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.632357] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.632501] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.632574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.632794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.632935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.649155] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 956.105065] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.105571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.105837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.107948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.107948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.107948] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad is going to be created. [ 956.142605] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.142605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.142605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.142605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.142605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.157607] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad in Status: UNINITIALIZED for 2s [ 957.665148] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 957.665584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.984765] env[66730]: INFO networking_nsxv3.common.synchronization [req-790585e0-fb01-4422-8be0-996f4f672d83 req-54b846ab-9a5a-4156-963a-6da781c5b932 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 957.985563] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 957.986017] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.986192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.986240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.986585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.986811] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.986987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.987126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.987483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.987629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.987789] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.169209] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad in Status: SUCCESS [ 958.169365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.169526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.169777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.171175] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.171175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.171175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.171175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.171175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.171175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.171175] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78eaf9ae-5f5d-4844-9951-fbe27a99cdad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.235925] env[66730]: INFO networking_nsxv3.common.synchronization [req-a235383d-ac39-4eee-baee-17990e972ed4 req-fe480c41-3edb-40f7-8f8c-c0554f6b505f tempest-ServersNegativeTestJSON-256798717 tempest-ServersNegativeTestJSON-256798717-project-member] Enqueued Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 958.236459] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc with Priority: HIGHEST for action security_group_members [ 958.238144] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.238738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.238851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.239108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.239336] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.239479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.239561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.239891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.239891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.239991] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11fac9ba-96d2-4dbb-99c3-f32131a3e0dc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.493115] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.575802] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.576174] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-382" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.576358] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-382" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.576597] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-382" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.576860] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.577026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.577147] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.577403] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.577533] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.577734] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.577875] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.577989] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.578130] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.578246] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.578351] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.578483] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.599636] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.599827] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 958.599926] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.600123] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-382" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.600461] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.600758] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.602063] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.602063] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.602063] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7891f6e-230b-4bc6-b5d3-9b6121430dbc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.672857] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78eaf9ae-5f5d-4844-9951-fbe27a99cdad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.742784] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.742964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.743035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.743259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.743349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.743571] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.743689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.743747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.744134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.744240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.744334] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc is going to be updated. [ 958.781277] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.781277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.781277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.781277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.781277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.797278] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: IN_PROGRESS for 2s [ 958.997953] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.104631] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.104988] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.105203] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.105781] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.105939] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.106192] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port d7891f6e-230b-4bc6-b5d3-9b6121430dbc not found, creating... [ 959.106594] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.106832] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.107017] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.107373] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.107567] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.108030] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.108219] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.108378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.108662] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.109054] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.109251] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: d7891f6e-230b-4bc6-b5d3-9b6121430dbc is going to be created. [ 959.135634] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.135952] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.135952] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.136397] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.136469] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.136671] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.175710] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78eaf9ae-5f5d-4844-9951-fbe27a99cdad: rpc.has_security_group_logging(os_id): False [ 959.199170] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.199447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.199447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.199892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.199998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.200297] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.200398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.200484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.200660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.200734] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.200796] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad is going to be created. [ 959.294421] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.294666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.294666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.294930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.295115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.315229] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad in Status: IN_PROGRESS for 2s [ 959.501341] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.502357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.503915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.504168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.504355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.504627] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 959.542062] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.542260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.542294] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.542503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.542697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.554922] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 959.957246] env[66730]: INFO networking_nsxv3.common.synchronization [req-790585e0-fb01-4422-8be0-996f4f672d83 req-c7da0f81-54de-4362-b1a2-8bda50bae3de service nova] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 959.959385] env[66730]: INFO networking_nsxv3.common.synchronization [req-790585e0-fb01-4422-8be0-996f4f672d83 req-c7da0f81-54de-4362-b1a2-8bda50bae3de service nova] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 959.959533] env[66730]: INFO networking_nsxv3.common.synchronization [req-790585e0-fb01-4422-8be0-996f4f672d83 req-c7da0f81-54de-4362-b1a2-8bda50bae3de service nova] Enqueued Resource ID: d7891f6e-230b-4bc6-b5d3-9b6121430dbc with Priority: HIGHEST for action port [ 959.960417] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 959.960733] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 959.960962] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7891f6e-230b-4bc6-b5d3-9b6121430dbc with Priority: HIGHEST for action port [ 959.961383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.961768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.961768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.962114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.962253] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.963632] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.963802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.964154] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.964316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.964460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.964779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.964938] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7891f6e-230b-4bc6-b5d3-9b6121430dbc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.385531] env[66730]: INFO networking_nsxv3.common.synchronization [None req-66f324b7-c291-4279-a196-7cf288a1a675 None None] Enqueued Resource ID: 9ab5764f-63df-4058-9ebc-0b7d96896f5b with Priority: HIGHEST for action port [ 960.385531] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ab5764f-63df-4058-9ebc-0b7d96896f5b with Priority: HIGHEST for action port [ 960.385531] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ab5764f-63df-4058-9ebc-0b7d96896f5b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.385531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ab5764f-63df-4058-9ebc-0b7d96896f5b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.385531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ab5764f-63df-4058-9ebc-0b7d96896f5b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.385531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ab5764f-63df-4058-9ebc-0b7d96896f5b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.385531] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ab5764f-63df-4058-9ebc-0b7d96896f5b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.467371] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.467533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.467798] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7891f6e-230b-4bc6-b5d3-9b6121430dbc with status ACTIVE [ 960.468130] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.468130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.468250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.468391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.468484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.468664] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.468799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.468865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.469069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.469175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.469381] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.469510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.469577] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.469769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.469863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.469969] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7891f6e-230b-4bc6-b5d3-9b6121430dbc is going to be updated. [ 960.500030] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.500030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.500030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.500030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.500030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.500030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.529676] env[66730]: INFO networking_nsxv3.common.synchronization [req-b4f2439f-82e0-42fd-ad79-c73f31a1d9d3 req-021cc148-7afe-46b1-b55c-28ec51c1d006 tempest-VolumesAdminNegativeTest-1928277589 tempest-VolumesAdminNegativeTest-1928277589-project-member] Enqueued Resource ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 with Priority: HIGHEST for action security_group_members [ 960.531233] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 with Priority: HIGHEST for action security_group_members [ 960.531794] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d8cbe5-bd50-4c8a-8227-fc6effa07719 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.531920] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.532079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.532319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.532477] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.532578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.532641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.532789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.532872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.532960] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03d8cbe5-bd50-4c8a-8227-fc6effa07719',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.811286] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc in Status: SUCCESS [ 960.811498] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11fac9ba-96d2-4dbb-99c3-f32131a3e0dc deletion is rescheduled due to dependency. [ 960.812013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11fac9ba-96d2-4dbb-99c3-f32131a3e0dc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.889169] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ab5764f-63df-4058-9ebc-0b7d96896f5b [ 960.889529] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.889885] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.890171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.890410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.890547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.890989] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ab5764f-63df-4058-9ebc-0b7d96896f5b already deleted. [ 960.891135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ab5764f-63df-4058-9ebc-0b7d96896f5b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.035298] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.035722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.035722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.035956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.036114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.036388] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.036535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.038689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.038689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.038689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.038689] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 already deleted. [ 961.038689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.158611] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-85 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.158810] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.158931] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.159337] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.160356] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.161490] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.161679] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.161922] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.162085] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.162304] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.162415] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.162522] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.162627] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.162732] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.162835] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.163488] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.184455] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.184896] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 961.185124] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.185319] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-85" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.185803] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-fd98042b-ba32-4913-9b04-5dca0621463a taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.186038] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-fd98042b-ba32-4913-9b04-5dca0621463a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.186155] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-fd98042b-ba32-4913-9b04-5dca0621463a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.186503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-fd98042b-ba32-4913-9b04-5dca0621463a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.186673] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd98042b-ba32-4913-9b04-5dca0621463a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.330511] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad in Status: SUCCESS [ 961.330810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.568228] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 961.568738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.568738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.568904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.569131] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.569259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.570107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.570107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.570107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.570107] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.690085] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.690237] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.690373] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.690842] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.691038] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.691251] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port fd98042b-ba32-4913-9b04-5dca0621463a not found, creating... [ 961.691624] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.691788] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.694020] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.694020] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.694020] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.694020] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.694020] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.694020] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.694020] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.694020] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.694020] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: fd98042b-ba32-4913-9b04-5dca0621463a is going to be created. [ 961.715564] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.715757] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.715871] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.716219] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.716484] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.716779] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-fd98042b-ba32-4913-9b04-5dca0621463a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.072186] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.495362] env[66730]: INFO networking_nsxv3.common.synchronization [req-b4f2439f-82e0-42fd-ad79-c73f31a1d9d3 req-b4e50696-0b7b-4c1f-acd8-412e26c1806d service nova] Enqueued Resource ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 with Priority: HIGHEST for action security_group_rules [ 962.495362] env[66730]: INFO networking_nsxv3.common.synchronization [req-b4f2439f-82e0-42fd-ad79-c73f31a1d9d3 req-b4e50696-0b7b-4c1f-acd8-412e26c1806d service nova] Enqueued Resource ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 with Priority: HIGHEST for action security_group_members [ 962.495362] env[66730]: INFO networking_nsxv3.common.synchronization [req-b4f2439f-82e0-42fd-ad79-c73f31a1d9d3 req-b4e50696-0b7b-4c1f-acd8-412e26c1806d service nova] Enqueued Resource ID: fd98042b-ba32-4913-9b04-5dca0621463a with Priority: HIGHEST for action port [ 962.495362] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 with Priority: HIGHEST for action security_group_rules [ 962.496305] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 with Priority: HIGHEST for action security_group_members [ 962.496548] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd98042b-ba32-4913-9b04-5dca0621463a with Priority: HIGHEST for action port [ 962.496960] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03d8cbe5-bd50-4c8a-8227-fc6effa07719 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.497252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.497458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.500018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.500018] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03d8cbe5-bd50-4c8a-8227-fc6effa07719',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.500018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d8cbe5-bd50-4c8a-8227-fc6effa07719 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.500018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.500018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.500018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.500809] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.501060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.501213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.501480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.501706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.501919] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03d8cbe5-bd50-4c8a-8227-fc6effa07719',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.504435] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd98042b-ba32-4913-9b04-5dca0621463a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.504692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd98042b-ba32-4913-9b04-5dca0621463a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.504836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd98042b-ba32-4913-9b04-5dca0621463a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.506017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd98042b-ba32-4913-9b04-5dca0621463a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.506017] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd98042b-ba32-4913-9b04-5dca0621463a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.576078] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.008154] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03d8cbe5-bd50-4c8a-8227-fc6effa07719',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.010602] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d8cbe5-bd50-4c8a-8227-fc6effa07719 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.010727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.010923] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd98042b-ba32-4913-9b04-5dca0621463a with status ACTIVE [ 963.011957] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.012108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.012182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.013060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.013790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.014133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.014265] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.014332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.014636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.014755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.015070] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.015239] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.015239] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.015418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.015514] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.015611] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd98042b-ba32-4913-9b04-5dca0621463a is going to be updated. [ 963.022162] env[66730]: INFO networking_nsxv3.common.synchronization [None req-52921238-18b0-4e3a-a396-63f5e6ac1acb None None] Enqueued Resource ID: c524d448-ad82-4e0b-a6c9-f857c97fe664 with Priority: HIGHEST for action port [ 963.023404] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c524d448-ad82-4e0b-a6c9-f857c97fe664 with Priority: HIGHEST for action port [ 963.023770] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-c524d448-ad82-4e0b-a6c9-f857c97fe664 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.024330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c524d448-ad82-4e0b-a6c9-f857c97fe664" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.024330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c524d448-ad82-4e0b-a6c9-f857c97fe664" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.024557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c524d448-ad82-4e0b-a6c9-f857c97fe664" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.024769] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c524d448-ad82-4e0b-a6c9-f857c97fe664',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.046945] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.047190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.047190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.047775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.047775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.047914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd98042b-ba32-4913-9b04-5dca0621463a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.078789] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.079189] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.079189] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.079302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.080276] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.080276] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 963.169196] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.169196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.169196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.169196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.169196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.187811] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 963.511115] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03d8cbe5-bd50-4c8a-8227-fc6effa07719',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.529590] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c524d448-ad82-4e0b-a6c9-f857c97fe664 [ 963.531365] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.531365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.531365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.531365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.531365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.531365] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c524d448-ad82-4e0b-a6c9-f857c97fe664 already deleted. [ 963.531365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c524d448-ad82-4e0b-a6c9-f857c97fe664" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.015666] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.015861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.015977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.017495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.017495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.017495] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 is going to be created. [ 964.065575] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.065815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.065887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.067181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.067181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.079567] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 in Status: UNINITIALIZED for 2s [ 965.200066] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 965.200483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.200483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.200973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.201175] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.201456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.201850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.202552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.202552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.202552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.202552] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.704700] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.704994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.704994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.705214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.705421] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.705584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.705702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.705949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.706107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.706271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.706523] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.706644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.706733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.706873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.707076] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.707172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.707231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.707377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.707443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.707526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.707620] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.091043] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 in Status: SUCCESS [ 966.091477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.091742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.092086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.092383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.092627] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.092739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.093098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.093253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.093462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.093630] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03d8cbe5-bd50-4c8a-8227-fc6effa07719',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.210132] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16d1896c-4d80-4a01-9c49-a61403e196c4: rpc.has_security_group_logging(os_id): False [ 966.233060] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.233194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.233339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.233557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.233681] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.233903] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.233996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.234095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.234436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.234436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.234584] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.234674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.234730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.235013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.235087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.235302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.235423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.235526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.235692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.235926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.235926] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 966.243484] env[66730]: INFO networking_nsxv3.common.synchronization [req-fdcdd090-0bf7-469e-8c64-cb14ef97bb39 req-4be8bb14-0465-4a44-9e09-b88b0cef24d1 tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_members [ 966.244102] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_members [ 966.244449] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af4fa83-97d6-42c2-b25a-f1300fa319d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.244568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.244628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.244959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.245130] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.245237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.245300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.245457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.245544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.245639] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.344774] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.345054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.345054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.345332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.345513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.368821] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 966.596934] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d8cbe5-bd50-4c8a-8227-fc6effa07719 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.597605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.597605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.597605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.597800] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.597800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.597903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.598045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.598191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.598296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.598444] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d8cbe5-bd50-4c8a-8227-fc6effa07719 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.598536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.598605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.598795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.598936] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.599063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.599136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.599300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.599381] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.599496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.599623] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03d8cbe5-bd50-4c8a-8227-fc6effa07719',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.692331] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.692650] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.692827] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.693135] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.693497] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.693694] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.693858] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.694237] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.694397] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.694652] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.694768] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.694941] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.695133] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.695288] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.695416] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.695613] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.717680] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.717944] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 966.718143] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.718349] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.718722] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-e201e7f4-6685-4e6e-b5d4-6c6fa74a1013 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.718946] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-e201e7f4-6685-4e6e-b5d4-6c6fa74a1013" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.719141] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-e201e7f4-6685-4e6e-b5d4-6c6fa74a1013" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.719639] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-e201e7f4-6685-4e6e-b5d4-6c6fa74a1013" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.719842] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e201e7f4-6685-4e6e-b5d4-6c6fa74a1013',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.747688] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.747972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.748132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.748424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.748546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.748858] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.748994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.749118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.749364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.749489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.749604] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 already deleted. [ 966.749737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.102550] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03d8cbe5-bd50-4c8a-8227-fc6effa07719: rpc.has_security_group_logging(os_id): False [ 967.124933] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.125173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.125259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.125589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.125708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.125953] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.126097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.126154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.126351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.126438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.126906] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.126906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.126906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.126906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.127066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.127225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.127348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.127429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.127592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.127677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.127766] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 is going to be created. [ 967.200671] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.200918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.200918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.201240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.201572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.216105] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 in Status: IN_PROGRESS for 2s [ 967.222575] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.222874] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.223067] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.223452] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.223668] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.223930] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port e201e7f4-6685-4e6e-b5d4-6c6fa74a1013 not found, creating... [ 967.224313] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.224580] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.224758] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.225106] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.225356] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.226034] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.226034] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.226218] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.226420] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.226631] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.226845] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: e201e7f4-6685-4e6e-b5d4-6c6fa74a1013 is going to be created. [ 967.267833] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.269735] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.269735] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.269735] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.269735] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.269735] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-e201e7f4-6685-4e6e-b5d4-6c6fa74a1013" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.039762] env[66730]: INFO networking_nsxv3.common.synchronization [req-fdcdd090-0bf7-469e-8c64-cb14ef97bb39 req-15525ded-bf1a-4cd2-b383-ca754f367e21 service nova] Enqueued Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_rules [ 968.039762] env[66730]: INFO networking_nsxv3.common.synchronization [req-fdcdd090-0bf7-469e-8c64-cb14ef97bb39 req-15525ded-bf1a-4cd2-b383-ca754f367e21 service nova] Enqueued Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_members [ 968.039762] env[66730]: INFO networking_nsxv3.common.synchronization [req-fdcdd090-0bf7-469e-8c64-cb14ef97bb39 req-15525ded-bf1a-4cd2-b383-ca754f367e21 service nova] Enqueued Resource ID: e201e7f4-6685-4e6e-b5d4-6c6fa74a1013 with Priority: HIGHEST for action port [ 968.040744] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_rules [ 968.040983] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_members [ 968.041189] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e201e7f4-6685-4e6e-b5d4-6c6fa74a1013 with Priority: HIGHEST for action port [ 968.041514] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.041698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.041811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.042099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.042323] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.045022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af4fa83-97d6-42c2-b25a-f1300fa319d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.045022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.045022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.045022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.045232] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.045282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.045588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.045622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.045741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.045954] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.047872] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e201e7f4-6685-4e6e-b5d4-6c6fa74a1013 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.047943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e201e7f4-6685-4e6e-b5d4-6c6fa74a1013" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.048429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e201e7f4-6685-4e6e-b5d4-6c6fa74a1013" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.048429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e201e7f4-6685-4e6e-b5d4-6c6fa74a1013" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.048429] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e201e7f4-6685-4e6e-b5d4-6c6fa74a1013',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.391336] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 968.391336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.547753] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af4fa83-97d6-42c2-b25a-f1300fa319d8 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.547753] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.551311] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.552591] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e201e7f4-6685-4e6e-b5d4-6c6fa74a1013 with status ACTIVE [ 968.552864] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.553081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.553172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.553385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.553508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.553749] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.553878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.553961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.558095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.558242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.558564] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.558768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.559269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.559624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.559774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.559900] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e201e7f4-6685-4e6e-b5d4-6c6fa74a1013 is going to be updated. [ 968.584198] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.584344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.584397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.584616] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.584915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.584915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e201e7f4-6685-4e6e-b5d4-6c6fa74a1013" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.063377] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.236601] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 in Status: SUCCESS [ 969.236830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.565637] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.566091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.566091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.566213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.566276] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.566440] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 is going to be created. [ 969.593813] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.593977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.594045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.594380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.594459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.607177] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 in Status: UNINITIALIZED for 2s [ 969.693249] env[66730]: INFO networking_nsxv3.common.synchronization [req-7d5ec800-bca9-4127-9adc-e12d4d014383 req-76ddde79-d798-46d8-a9f7-198a1f2db94a tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_members [ 969.693423] env[66730]: INFO networking_nsxv3.common.synchronization [req-7d5ec800-bca9-4127-9adc-e12d4d014383 req-76ddde79-d798-46d8-a9f7-198a1f2db94a tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 969.693995] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_members [ 969.694524] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 969.694924] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.695126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.695243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.695576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.695839] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.696040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.696207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.696458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.696634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.696829] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.699144] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.699236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.699869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.699869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.699869] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.700069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.700138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.700431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.700612] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.700783] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.894103] env[66730]: INFO networking_nsxv3.common.synchronization [req-7d5ec800-bca9-4127-9adc-e12d4d014383 req-76ddde79-d798-46d8-a9f7-198a1f2db94a tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 969.894224] env[66730]: INFO networking_nsxv3.common.synchronization [req-7d5ec800-bca9-4127-9adc-e12d4d014383 req-76ddde79-d798-46d8-a9f7-198a1f2db94a tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 969.894453] env[66730]: INFO networking_nsxv3.common.synchronization [req-7d5ec800-bca9-4127-9adc-e12d4d014383 req-76ddde79-d798-46d8-a9f7-198a1f2db94a tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_rules [ 969.894544] env[66730]: INFO networking_nsxv3.common.synchronization [req-7d5ec800-bca9-4127-9adc-e12d4d014383 req-76ddde79-d798-46d8-a9f7-198a1f2db94a tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_members [ 969.894666] env[66730]: INFO networking_nsxv3.common.synchronization [req-7d5ec800-bca9-4127-9adc-e12d4d014383 req-76ddde79-d798-46d8-a9f7-198a1f2db94a tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: d7891f6e-230b-4bc6-b5d3-9b6121430dbc with Priority: HIGHEST for action port [ 969.895226] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 969.895347] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_rules [ 969.895476] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7891f6e-230b-4bc6-b5d3-9b6121430dbc with Priority: HIGHEST for action port [ 969.895593] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 969.895691] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_members [ 969.896324] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.896527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.896610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.896822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.896932] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.898548] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.898548] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.898548] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.898548] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.898548] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.899323] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.900530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.900530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.900530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.900530] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7891f6e-230b-4bc6-b5d3-9b6121430dbc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.900530] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.900834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.900834] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.900834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.112661] env[66730]: INFO networking_nsxv3.common.synchronization [None req-990e069a-359c-4d02-b234-0d0470fdc2c7 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_rules [ 970.113749] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_rules [ 970.113867] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.114253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.114253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.114499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.114499] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.199359] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.204706] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.214597] env[66730]: INFO networking_nsxv3.common.synchronization [None req-6d19d2c5-26c2-4fb7-ab78-6a98be41f399 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_rules [ 970.215182] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_rules [ 970.216072] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.216207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.401736] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.401973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.402253] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.402354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.403740] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7891f6e-230b-4bc6-b5d3-9b6121430dbc with status ACTIVE [ 970.403954] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.404110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.404200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.404537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.404625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.404744] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.404846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.404906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.405104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.405187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.405457] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.405516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.405657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.405728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.405803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.405888] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7891f6e-230b-4bc6-b5d3-9b6121430dbc is going to be updated. [ 970.431476] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.431561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.431721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.432011] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.432309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.432541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.636582] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.636935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.636935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.637144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.637344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.637408] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 already deleted. [ 970.637459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.637637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.637852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.637961] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.702125] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.708083] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.162944] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.163096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.163172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.163392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.163634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.163634] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 already deleted. [ 971.163743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.208055] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.208055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.208055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.208055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.208055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.208055] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 is going to be created. [ 971.210380] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.211075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.211787] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.212531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.212531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.212702] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 971.245432] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.245666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.245759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.246464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.246464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.266870] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.266870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.267088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.269056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.269056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.269665] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: UNINITIALIZED for 2s [ 971.279945] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 971.328849] env[66730]: INFO networking_nsxv3.common.synchronization [req-61c87532-6fbf-48f6-bfb4-c3cc6345fcbb req-f0980b0a-aeb6-447b-a38c-4bb13643c473 tempest-ServerRescueTestJSON-513474333 tempest-ServerRescueTestJSON-513474333-project-member] Enqueued Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 971.329787] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 971.331397] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.331676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.331777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.332343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.332862] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.333084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.333172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.333467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.333650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.333844] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.620239] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 in Status: SUCCESS [ 971.620239] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.620239] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.620459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.620614] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.620760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.620858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.621112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.621232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.621359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.621495] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.839998] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.839998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.839998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.839998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.839998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.839998] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.839998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.839998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.839998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.839998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.839998] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae31dacc-8242-4331-8786-1526682530bd already deleted. [ 971.839998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.895201] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-650 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.895201] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-650" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.895201] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-650" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.895466] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-650" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.898053] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.898053] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.898053] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.898053] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.898053] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.898053] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.898053] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.898053] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.898053] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.898724] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.898724] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.898724] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.922211] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.922374] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.922509] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.922682] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-650" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.922997] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-7be5b90b-8bf2-43ff-9043-6da042ed282e taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.923180] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-7be5b90b-8bf2-43ff-9043-6da042ed282e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.923290] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-7be5b90b-8bf2-43ff-9043-6da042ed282e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.923762] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-7be5b90b-8bf2-43ff-9043-6da042ed282e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.925066] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7be5b90b-8bf2-43ff-9043-6da042ed282e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.124860] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.429207] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.429207] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.429207] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.430160] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.430690] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.430690] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 7be5b90b-8bf2-43ff-9043-6da042ed282e not found, creating... [ 972.430898] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.431150] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.431314] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.431656] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.431759] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.432139] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.432939] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.432939] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.432939] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.432939] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.433235] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 7be5b90b-8bf2-43ff-9043-6da042ed282e is going to be created. [ 972.460674] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.461031] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.461110] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.461380] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.461609] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.462138] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-7be5b90b-8bf2-43ff-9043-6da042ed282e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.626645] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0af4fa83-97d6-42c2-b25a-f1300fa319d8: rpc.has_security_group_logging(os_id): False [ 972.659768] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.659970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.660032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.660229] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.660318] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.660619] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.660736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.660799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.660960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.661060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.661152] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 is going to be created. [ 972.748995] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.749217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.749217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.749449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.749744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.766483] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 in Status: IN_PROGRESS for 2s [ 973.237200] env[66730]: INFO networking_nsxv3.common.synchronization [req-61c87532-6fbf-48f6-bfb4-c3cc6345fcbb req-7bceded2-afa0-490e-a696-af0ea2a41d44 service nova] Enqueued Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_rules [ 973.237200] env[66730]: INFO networking_nsxv3.common.synchronization [req-61c87532-6fbf-48f6-bfb4-c3cc6345fcbb req-7bceded2-afa0-490e-a696-af0ea2a41d44 service nova] Enqueued Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 973.237200] env[66730]: INFO networking_nsxv3.common.synchronization [req-61c87532-6fbf-48f6-bfb4-c3cc6345fcbb req-7bceded2-afa0-490e-a696-af0ea2a41d44 service nova] Enqueued Resource ID: 7be5b90b-8bf2-43ff-9043-6da042ed282e with Priority: HIGHEST for action port [ 973.238901] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_rules [ 973.238901] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 973.238901] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7be5b90b-8bf2-43ff-9043-6da042ed282e with Priority: HIGHEST for action port [ 973.239229] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.239402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.239481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.240136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.240136] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.242026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.242026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.242026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.242241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.242547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.244448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.244448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.244448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.244448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.244448] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.244448] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-7be5b90b-8bf2-43ff-9043-6da042ed282e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.244448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7be5b90b-8bf2-43ff-9043-6da042ed282e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.245200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7be5b90b-8bf2-43ff-9043-6da042ed282e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.245200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7be5b90b-8bf2-43ff-9043-6da042ed282e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.245200] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7be5b90b-8bf2-43ff-9043-6da042ed282e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.282613] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: SUCCESS [ 973.282858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.283446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.283703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.283873] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.283991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.284225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.284391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.285728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.285728] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.325838] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 973.326120] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.326365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.326653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.326829] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.326968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.327080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.327326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.327446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.327591] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.742449] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.742654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.747814] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7be5b90b-8bf2-43ff-9043-6da042ed282e with status ACTIVE [ 973.748057] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.748191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.748255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.748493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.748561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.749134] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.749134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.749134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.749134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.749134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.749591] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.749591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.749591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.749737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.749737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.749804] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7be5b90b-8bf2-43ff-9043-6da042ed282e is going to be updated. [ 973.751186] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.788044] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.798410] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.798410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.798410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.799238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.799709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.800598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7be5b90b-8bf2-43ff-9043-6da042ed282e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.830350] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.253891] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.291280] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.335011] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.761594] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.761594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.761594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.761594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.761594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.761594] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae31dacc-8242-4331-8786-1526682530bd is going to be created. [ 974.795405] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.795405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.795405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.795811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.795811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.795811] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 is going to be updated. [ 974.804433] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 in Status: SUCCESS [ 974.804713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.821798] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.822120] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.822120] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.822306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.822388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.834863] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: UNINITIALIZED for 2s [ 974.845677] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.845677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.845677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.845677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.845677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.845677] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 974.849992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.850612] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.850612] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.850960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.851222] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.878792] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: IN_PROGRESS for 2s [ 974.896208] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.896445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.896517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.896719] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.896896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.912571] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 976.225999] env[66730]: INFO networking_nsxv3.common.synchronization [req-b8e4e22f-dfc8-488d-a880-c7245a79094f req-348992c5-cf3a-4db1-91a2-691ece4188c9 tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 976.227097] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 976.227097] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.227097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.227379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.227379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.227549] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.227651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.227703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.227859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.227948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.228053] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.724422] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-223 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.724422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.724422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.724723] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.724996] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.725175] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.725314] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.725540] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.725720] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.725945] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.726075] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.726186] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.726290] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.726395] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.726497] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.726628] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.730888] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.731053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.731096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.731278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.731364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.731594] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.731684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.731749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.731921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.732016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.732122] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 already deleted. [ 976.732204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.752791] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.752791] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.752791] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.752791] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.752791] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-39f5d39e-684d-40a1-9cc9-6583a9b65683 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.752791] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-39f5d39e-684d-40a1-9cc9-6583a9b65683" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.752791] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-39f5d39e-684d-40a1-9cc9-6583a9b65683" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.752791] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-39f5d39e-684d-40a1-9cc9-6583a9b65683" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.752791] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39f5d39e-684d-40a1-9cc9-6583a9b65683',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.846864] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: SUCCESS [ 976.847175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.847657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.847943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.848524] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.848524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.848524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.848524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.848746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.848746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.848746] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.891506] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: SUCCESS [ 976.891506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.891690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.891915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.892407] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.892557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.892664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.892872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.892990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.893073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.893190] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.926198] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 976.926198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.926768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.926991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.927239] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.927313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.927377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.927595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.927714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.927714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.928366] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.985805] env[66730]: INFO networking_nsxv3.common.synchronization [req-90f36ec8-15ac-4a34-856c-a20e24643d14 req-b90ded9d-813a-4eaf-b42c-948d5f4a5c93 tempest-ImagesTestJSON-681326034 tempest-ImagesTestJSON-681326034-project-member] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 976.985975] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 976.986510] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.987026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.987148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.987494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.987765] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.987948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.988182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.988600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.988790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.988999] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.254847] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.255425] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.255425] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.255535] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.255644] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.255818] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 39f5d39e-684d-40a1-9cc9-6583a9b65683 not found, creating... [ 977.256105] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.256257] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.256388] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.256713] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.256858] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.257245] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.257389] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.257624] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.257820] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.257964] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.258129] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 39f5d39e-684d-40a1-9cc9-6583a9b65683 is going to be created. [ 977.282699] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.283143] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.283236] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.283516] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.283746] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.283968] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-39f5d39e-684d-40a1-9cc9-6583a9b65683" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.353167] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.353499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.353748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.354131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.355097] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.355286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.355451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.355761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.355944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.356146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.356459] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.357194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.357292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.357454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.357821] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.357973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.358076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.358288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.358407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.359031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.359031] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.396641] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.430231] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.430397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.430461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.432067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.432426] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.432602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.432687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.432921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.433022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.433119] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.433286] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.433378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.433456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.433639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.433792] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.433883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.433963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.434216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.434345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.434486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.434679] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.492205] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.492359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.492432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.492785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.492785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.492969] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.493089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.493150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.493308] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.493384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.493472] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 977.544790] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.547023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.547023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.547023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.547023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.564046] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 977.862247] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae31dacc-8242-4331-8786-1526682530bd: rpc.has_security_group_logging(os_id): False [ 977.887704] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.888394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.888394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.888394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.888394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.888580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.888737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.888812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.890693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.890693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.890693] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.890693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.890693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.890693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.890693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.890693] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.890693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.890693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.890693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.890693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.890693] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae31dacc-8242-4331-8786-1526682530bd is going to be created. [ 977.903191] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121: rpc.has_security_group_logging(os_id): False [ 977.931950] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.932178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.932278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.932513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.932633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.932998] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.933117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.933335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.933397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.933459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.933576] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 is going to be created. [ 977.939730] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16d1896c-4d80-4a01-9c49-a61403e196c4: rpc.has_security_group_logging(os_id): False [ 977.969019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.969019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.969019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.969019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.969019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.969019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.969019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.969019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.969019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.969019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.969547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.969547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.969547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.969547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.969547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.969773] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.970117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.970251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.970407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.970482] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.970570] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 977.995641] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.995641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.995641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.995641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.997046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.006327] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.006327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.006327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.006669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.007115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.021756] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: IN_PROGRESS for 2s [ 978.022882] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: IN_PROGRESS for 2s [ 978.108291] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.108291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.108291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.108291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.108291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.159498] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 978.186131] env[66730]: INFO networking_nsxv3.common.synchronization [req-b8e4e22f-dfc8-488d-a880-c7245a79094f req-633d71d0-c561-4c8a-8226-dd56cbfc9aea service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 978.186395] env[66730]: INFO networking_nsxv3.common.synchronization [req-b8e4e22f-dfc8-488d-a880-c7245a79094f req-633d71d0-c561-4c8a-8226-dd56cbfc9aea service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 978.186799] env[66730]: INFO networking_nsxv3.common.synchronization [req-b8e4e22f-dfc8-488d-a880-c7245a79094f req-633d71d0-c561-4c8a-8226-dd56cbfc9aea service nova] Enqueued Resource ID: 39f5d39e-684d-40a1-9cc9-6583a9b65683 with Priority: HIGHEST for action port [ 978.188016] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 978.188016] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 978.188016] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f5d39e-684d-40a1-9cc9-6583a9b65683 with Priority: HIGHEST for action port [ 978.188523] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.188758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.188871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.189320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.189399] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.190705] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.190857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.190922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.191159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.191350] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.191458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.191668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.191812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.191936] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.194646] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.194646] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-39f5d39e-684d-40a1-9cc9-6583a9b65683 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.194646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39f5d39e-684d-40a1-9cc9-6583a9b65683" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.194646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39f5d39e-684d-40a1-9cc9-6583a9b65683" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.194646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39f5d39e-684d-40a1-9cc9-6583a9b65683" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.194646] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39f5d39e-684d-40a1-9cc9-6583a9b65683',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.695040] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.696176] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.696315] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.696656] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39f5d39e-684d-40a1-9cc9-6583a9b65683 with status ACTIVE [ 978.696815] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.696915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.697037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.697219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.697289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.697456] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.697543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.697594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.697742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.697815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.697997] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.698093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.698147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.698289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.698364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.698487] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39f5d39e-684d-40a1-9cc9-6583a9b65683 is going to be updated. [ 978.736888] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.737150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.737150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.737387] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.737608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.737886] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39f5d39e-684d-40a1-9cc9-6583a9b65683" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.051435] env[66730]: INFO networking_nsxv3.common.synchronization [req-a8633f2d-bee5-4803-9997-f012479bba8b req-f93be440-d28e-450c-ac40-2b53fa06fb76 tempest-ListImageFiltersTestJSON-1967883334 tempest-ListImageFiltersTestJSON-1967883334-project-member] Enqueued Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 979.052401] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 979.052704] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.052855] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.052926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.053265] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.053465] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.053628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.053763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.053965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.054111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.054238] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.199455] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.515777] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.515980] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.516082] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.516395] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.516617] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.516773] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.516887] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.519884] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.520173] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.520421] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.520552] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.520700] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.520817] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.520927] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.521042] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.521186] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.551095] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.551891] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 979.552619] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.552619] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.553196] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-9e9abaa3-e096-45dd-9301-0deeaff652b2 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.553567] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-9e9abaa3-e096-45dd-9301-0deeaff652b2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.553815] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-9e9abaa3-e096-45dd-9301-0deeaff652b2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.554355] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-9e9abaa3-e096-45dd-9301-0deeaff652b2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.556607] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e9abaa3-e096-45dd-9301-0deeaff652b2',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.556708] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.557791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.557791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.557791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.557791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.557791] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.557791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.558281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.558597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.558769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.559585] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 already deleted. [ 979.559735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.580625] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 979.580881] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 deletion is rescheduled due to dependency. [ 979.580996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.702581] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.702940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.702940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.703048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.703141] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.703241] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be created. [ 979.731815] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.732075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.732199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.732524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.732744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.745327] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: UNINITIALIZED for 2s [ 980.038373] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: SUCCESS [ 980.039029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.040570] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: SUCCESS [ 980.041182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.061661] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.062465] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.063385] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.063738] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.065308] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.065511] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 9e9abaa3-e096-45dd-9301-0deeaff652b2 not found, creating... [ 980.065831] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.066070] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.066198] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.066447] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.066663] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.066980] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.067150] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.067265] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.067506] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.067650] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.067787] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 9e9abaa3-e096-45dd-9301-0deeaff652b2 is going to be created. [ 980.090461] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.090681] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.090804] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.091125] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.091403] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.091694] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-9e9abaa3-e096-45dd-9301-0deeaff652b2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.164029] env[66730]: INFO networking_nsxv3.common.synchronization [req-3ac00992-47fb-469e-921f-df6582aa5221 req-f6582822-fb00-4bd7-8462-2cd1b00f67c3 tempest-VolumesAdminNegativeTest-1928277589 tempest-VolumesAdminNegativeTest-1928277589-project-member] Enqueued Resource ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 with Priority: HIGHEST for action security_group_members [ 980.164644] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 with Priority: HIGHEST for action security_group_members [ 980.165077] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d8cbe5-bd50-4c8a-8227-fc6effa07719 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.165217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.165306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.165524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.165728] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.165850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.165919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.166129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.166224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.166347] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03d8cbe5-bd50-4c8a-8227-fc6effa07719',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.203942] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 980.204265] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.559229] env[66730]: INFO networking_nsxv3.common.synchronization [req-f3996306-cb1d-47a2-bb41-693e50ecc460 req-bee36e6f-928b-412e-b35d-16820756cc37 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 66059812-5f73-418f-ad78-6bf59383a388 with Priority: HIGHEST for action security_group_members [ 980.559405] env[66730]: INFO networking_nsxv3.common.synchronization [req-f3996306-cb1d-47a2-bb41-693e50ecc460 req-bee36e6f-928b-412e-b35d-16820756cc37 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 980.559585] env[66730]: INFO networking_nsxv3.common.synchronization [req-f3996306-cb1d-47a2-bb41-693e50ecc460 req-bee36e6f-928b-412e-b35d-16820756cc37 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_members [ 980.560356] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66059812-5f73-418f-ad78-6bf59383a388 with Priority: HIGHEST for action security_group_members [ 980.560580] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 980.560741] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_members [ 980.563177] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-66059812-5f73-418f-ad78-6bf59383a388 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.563177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.563177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.563177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.563177] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.563177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.563177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.563177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.563177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.563177] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66059812-5f73-418f-ad78-6bf59383a388',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.564227] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.564365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.564459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.564815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.564850] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.565082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.565082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.565229] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.565335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.565452] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.570808] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.571038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.571317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.571436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.571681] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.571845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.571945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.572208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.572339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.572478] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.579641] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66059812-5f73-418f-ad78-6bf59383a388',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.638749] env[66730]: INFO networking_nsxv3.common.synchronization [req-f3996306-cb1d-47a2-bb41-693e50ecc460 req-bee36e6f-928b-412e-b35d-16820756cc37 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 980.638924] env[66730]: INFO networking_nsxv3.common.synchronization [req-f3996306-cb1d-47a2-bb41-693e50ecc460 req-bee36e6f-928b-412e-b35d-16820756cc37 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 980.639171] env[66730]: INFO networking_nsxv3.common.synchronization [req-f3996306-cb1d-47a2-bb41-693e50ecc460 req-bee36e6f-928b-412e-b35d-16820756cc37 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_rules [ 980.639382] env[66730]: INFO networking_nsxv3.common.synchronization [req-f3996306-cb1d-47a2-bb41-693e50ecc460 req-bee36e6f-928b-412e-b35d-16820756cc37 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_members [ 980.640693] env[66730]: INFO networking_nsxv3.common.synchronization [req-f3996306-cb1d-47a2-bb41-693e50ecc460 req-bee36e6f-928b-412e-b35d-16820756cc37 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 66059812-5f73-418f-ad78-6bf59383a388 with Priority: HIGHEST for action security_group_rules [ 980.640693] env[66730]: INFO networking_nsxv3.common.synchronization [req-f3996306-cb1d-47a2-bb41-693e50ecc460 req-bee36e6f-928b-412e-b35d-16820756cc37 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 66059812-5f73-418f-ad78-6bf59383a388 with Priority: HIGHEST for action security_group_members [ 980.640693] env[66730]: INFO networking_nsxv3.common.synchronization [req-f3996306-cb1d-47a2-bb41-693e50ecc460 req-bee36e6f-928b-412e-b35d-16820756cc37 tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: d7891f6e-230b-4bc6-b5d3-9b6121430dbc with Priority: HIGHEST for action port [ 980.640994] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_rules [ 980.640994] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_rules [ 980.641072] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66059812-5f73-418f-ad78-6bf59383a388 with Priority: HIGHEST for action security_group_members [ 980.641222] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7891f6e-230b-4bc6-b5d3-9b6121430dbc with Priority: HIGHEST for action port [ 980.641332] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66059812-5f73-418f-ad78-6bf59383a388 with Priority: HIGHEST for action security_group_rules [ 980.641470] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 980.641599] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_members [ 980.642022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.642219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.642337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.642629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.642784] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.643914] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.644085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.644175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.644400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.644507] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.645581] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-66059812-5f73-418f-ad78-6bf59383a388 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.645720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.646031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.646181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.646274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.646504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.646854] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7891f6e-230b-4bc6-b5d3-9b6121430dbc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.647631] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66059812-5f73-418f-ad78-6bf59383a388 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.647796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.647898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.648161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.648262] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66059812-5f73-418f-ad78-6bf59383a388',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.650579] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.650723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.651012] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.651182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.668732] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.668922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.668979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.669309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.669894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.669894] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.670075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.670075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.670331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.670450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.670584] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 is going to be updated. [ 980.703741] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.704199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.704199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.704793] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.704793] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.716740] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 in Status: IN_PROGRESS for 2s [ 980.888486] env[66730]: INFO networking_nsxv3.common.synchronization [req-a8633f2d-bee5-4803-9997-f012479bba8b req-4780a949-0dcb-4f7d-8910-2233391c1760 service nova] Enqueued Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_rules [ 980.888666] env[66730]: INFO networking_nsxv3.common.synchronization [req-a8633f2d-bee5-4803-9997-f012479bba8b req-4780a949-0dcb-4f7d-8910-2233391c1760 service nova] Enqueued Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 980.889009] env[66730]: INFO networking_nsxv3.common.synchronization [req-a8633f2d-bee5-4803-9997-f012479bba8b req-4780a949-0dcb-4f7d-8910-2233391c1760 service nova] Enqueued Resource ID: 9e9abaa3-e096-45dd-9301-0deeaff652b2 with Priority: HIGHEST for action port [ 980.889784] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_rules [ 980.889784] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 980.889896] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e9abaa3-e096-45dd-9301-0deeaff652b2 with Priority: HIGHEST for action port [ 980.890178] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.890304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.890372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.890692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.890841] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.893756] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.893756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.893756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.893756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.893756] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.894100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.894100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.894100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.894190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.894280] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.895942] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e9abaa3-e096-45dd-9301-0deeaff652b2 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.895942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e9abaa3-e096-45dd-9301-0deeaff652b2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.895942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e9abaa3-e096-45dd-9301-0deeaff652b2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.896180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e9abaa3-e096-45dd-9301-0deeaff652b2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.896180] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e9abaa3-e096-45dd-9301-0deeaff652b2',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.079927] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.082299] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.083083] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66059812-5f73-418f-ad78-6bf59383a388',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.155023] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7891f6e-230b-4bc6-b5d3-9b6121430dbc with status ACTIVE [ 981.155023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.155023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.155023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.155023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.156802] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7891f6e-230b-4bc6-b5d3-9b6121430dbc is going to be updated. [ 981.158580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.158900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.159312] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.159597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.160049] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-66059812-5f73-418f-ad78-6bf59383a388 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.161028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.183862] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.183986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.184128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.184388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.184663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.184740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7891f6e-230b-4bc6-b5d3-9b6121430dbc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.394231] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.394682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.398361] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e9abaa3-e096-45dd-9301-0deeaff652b2 with status ACTIVE [ 981.399293] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.399584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.400669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.400962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.401095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.401313] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.401430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.401497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.401670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.401908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.401968] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.402058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.402120] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.402264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.402340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.402424] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e9abaa3-e096-45dd-9301-0deeaff652b2 is going to be updated. [ 981.403999] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.433800] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.434044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.434103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.434335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.434513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.434781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e9abaa3-e096-45dd-9301-0deeaff652b2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.470464] env[66730]: INFO networking_nsxv3.common.synchronization [req-ef4920d7-71a7-45f2-8480-0071eaf7b2bb req-319cb667-c182-48f5-9f26-db0e399bc39e tempest-ListImageFiltersTestJSON-1967883334 tempest-ListImageFiltersTestJSON-1967883334-project-member] Enqueued Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 981.470464] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 981.471415] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.471648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.583720] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.584774] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.587823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.587823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.587823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.588956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.588956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.588956] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66059812-5f73-418f-ad78-6bf59383a388 is going to be created. [ 981.625873] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.625873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.625873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.625873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.625873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.639670] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66059812-5f73-418f-ad78-6bf59383a388 in Status: UNINITIALIZED for 2s [ 981.757231] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 981.757562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.757688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.758420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.758420] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.758420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.758420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.758922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.758992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.759080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.759193] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.885211] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.885211] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.885211] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.885620] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.885662] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.885919] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.886348] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.886732] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.888156] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.888156] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.888156] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.888156] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.888156] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.888441] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.888505] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.888730] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.906484] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.910456] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.910628] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 981.910810] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.910989] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-226" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.911454] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-b8ed3dfa-c908-4511-b444-8fcc13b78647 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.911631] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-b8ed3dfa-c908-4511-b444-8fcc13b78647" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.911749] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-b8ed3dfa-c908-4511-b444-8fcc13b78647" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.912110] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-b8ed3dfa-c908-4511-b444-8fcc13b78647" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.912249] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8ed3dfa-c908-4511-b444-8fcc13b78647',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.094694] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.099298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.099298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.099298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.099298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.099298] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 982.099298] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.100620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.100950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.101450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.102029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.102363] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 is going to be updated. [ 982.134302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.137023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.137023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.137023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.137023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.137378] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.137643] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.137810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.138097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.138336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.149807] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: IN_PROGRESS for 2s [ 982.149807] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 982.262807] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.263015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.263058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.263276] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.263457] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.263570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.263634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.263787] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.263871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.263957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.264121] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.264215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.264275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.264416] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.264552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.266808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.266808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.266808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.266808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.266808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.266808] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.409186] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.409392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.409392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.409682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.409778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.409880] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 is going to be created. [ 982.415911] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.416234] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.416422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.416879] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.417145] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.417383] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port b8ed3dfa-c908-4511-b444-8fcc13b78647 not found, creating... [ 982.417858] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.419272] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.419460] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.419783] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.419953] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.420312] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.420471] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.420614] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.420855] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.420992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.421145] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: b8ed3dfa-c908-4511-b444-8fcc13b78647 is going to be created. [ 982.455144] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.455469] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.456071] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.456071] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.456272] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.456390] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-b8ed3dfa-c908-4511-b444-8fcc13b78647" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.463897] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.464249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.464249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.464436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.464601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.478100] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: UNINITIALIZED for 2s [ 982.728545] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 in Status: SUCCESS [ 982.728752] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 deletion is rescheduled due to dependency. [ 982.728885] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.769579] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3e2980-ed0f-4c18-a149-cded1b258ec9: rpc.has_security_group_logging(os_id): False [ 982.788603] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.788804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.788804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.789090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.789182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.789389] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.789492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.789602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.789789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.789900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.790135] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.790252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.790332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.790486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.790575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.790801] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.790901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.790967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.791144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.791221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.791336] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be created. [ 982.888329] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.888472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.888535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.888759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.888934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.917641] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 983.167237] env[66730]: INFO networking_nsxv3.common.synchronization [req-ef4920d7-71a7-45f2-8480-0071eaf7b2bb req-6f230c87-eb2b-4193-880d-2f85e18c5493 service nova] Enqueued Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_rules [ 983.167237] env[66730]: INFO networking_nsxv3.common.synchronization [req-ef4920d7-71a7-45f2-8480-0071eaf7b2bb req-6f230c87-eb2b-4193-880d-2f85e18c5493 service nova] Enqueued Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 983.167505] env[66730]: INFO networking_nsxv3.common.synchronization [req-ef4920d7-71a7-45f2-8480-0071eaf7b2bb req-6f230c87-eb2b-4193-880d-2f85e18c5493 service nova] Enqueued Resource ID: b8ed3dfa-c908-4511-b444-8fcc13b78647 with Priority: HIGHEST for action port [ 983.168490] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_rules [ 983.168490] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 983.168490] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ed3dfa-c908-4511-b444-8fcc13b78647 with Priority: HIGHEST for action port [ 983.169408] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.169408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.169408] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.169408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.170411] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8ed3dfa-c908-4511-b444-8fcc13b78647 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.170411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8ed3dfa-c908-4511-b444-8fcc13b78647" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.170411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8ed3dfa-c908-4511-b444-8fcc13b78647" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.170411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8ed3dfa-c908-4511-b444-8fcc13b78647" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.170411] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8ed3dfa-c908-4511-b444-8fcc13b78647',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.651908] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66059812-5f73-418f-ad78-6bf59383a388 in Status: SUCCESS [ 983.651908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.651908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.651908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.651908] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.651908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.651908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.651908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.651908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.651908] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66059812-5f73-418f-ad78-6bf59383a388',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.673835] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8ed3dfa-c908-4511-b444-8fcc13b78647 with status ACTIVE [ 983.674083] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.674223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.674303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.675873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.676047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.676281] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.676394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.676462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.676648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.676760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.676911] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.677038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.677076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.677225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.677284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.677370] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8ed3dfa-c908-4511-b444-8fcc13b78647 is going to be updated. [ 983.727265] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.727454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.727647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.727962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.728054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.728234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8ed3dfa-c908-4511-b444-8fcc13b78647" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.057080] env[66730]: INFO networking_nsxv3.common.synchronization [req-1a4efdf4-b340-4e05-8c8e-cf6ff203f2ea req-748d052d-c92e-4631-9f16-505bbe8237ab tempest-ServerActionsTestOtherB-1094684457 tempest-ServerActionsTestOtherB-1094684457-project-member] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 984.057749] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 984.058129] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.058280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.058370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.058695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.059074] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.059224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.059311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.059497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.059619] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.059733] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.156752] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66059812-5f73-418f-ad78-6bf59383a388',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.167154] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 984.167307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.167962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.167962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.167962] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.168144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.168144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.168450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.168450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.168537] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.171122] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: SUCCESS [ 984.171430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.177696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.178245] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.178245] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.178402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.178459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.178589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.178683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.178781] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.180737] env[66730]: INFO networking_nsxv3.common.synchronization [req-440b2783-ab0e-4177-bf75-e698b3558fb7 req-0eb9368a-16ba-446b-9305-46eace9a525c tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_members [ 984.180737] env[66730]: INFO networking_nsxv3.common.synchronization [req-440b2783-ab0e-4177-bf75-e698b3558fb7 req-0eb9368a-16ba-446b-9305-46eace9a525c tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 66059812-5f73-418f-ad78-6bf59383a388 with Priority: HIGHEST for action security_group_members [ 984.180876] env[66730]: INFO networking_nsxv3.common.synchronization [req-440b2783-ab0e-4177-bf75-e698b3558fb7 req-0eb9368a-16ba-446b-9305-46eace9a525c tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 984.185942] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGHEST for action security_group_members [ 984.186162] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66059812-5f73-418f-ad78-6bf59383a388 with Priority: HIGHEST for action security_group_members [ 984.186549] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 984.186886] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.187017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.187261] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-66059812-5f73-418f-ad78-6bf59383a388 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.187569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.187631] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.187701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.489094] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: SUCCESS [ 984.490249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.490249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.490249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.490249] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.490249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.490249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.490249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.490691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.490691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.490691] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.491758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.491758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.491758] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.491758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.492123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.492123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.492123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.492123] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.502494] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.502678] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.502800] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.503067] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.503331] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.503753] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.503878] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.504108] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.504247] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.504446] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.504554] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.504657] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.504761] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.504864] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.504961] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.505103] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.542264] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.542432] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 984.543261] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.543261] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.543261] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-539882a2-0fc3-4068-89a4-80479c0ef8e5 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.543261] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-539882a2-0fc3-4068-89a4-80479c0ef8e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.543513] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-539882a2-0fc3-4068-89a4-80479c0ef8e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.543957] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-539882a2-0fc3-4068-89a4-80479c0ef8e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.543957] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('539882a2-0fc3-4068-89a4-80479c0ef8e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.564648] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.565601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.565601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.565601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.565601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.565601] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.565601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.565601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.565847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.565847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.565847] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 984.594207] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.594377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.594423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.594610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.594740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.606379] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 984.661429] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66059812-5f73-418f-ad78-6bf59383a388',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.686069] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.687533] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.687533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.687533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.687533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.687750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.688157] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.688157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.688157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.688314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.688314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.688376] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 is going to be updated. [ 984.728412] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.728640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.728640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.728827] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.728966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.740394] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: IN_PROGRESS for 2s [ 984.930655] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 984.930933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.993578] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.993738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.993904] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.045809] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.046043] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.046173] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.046448] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.046594] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.046768] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 539882a2-0fc3-4068-89a4-80479c0ef8e5 not found, creating... [ 985.047064] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.047230] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.047351] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.047611] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.047755] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.048112] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.048241] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.048329] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.048529] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.048663] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.048802] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 539882a2-0fc3-4068-89a4-80479c0ef8e5 is going to be created. [ 985.076366] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.076821] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.076821] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.077013] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.077263] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.077575] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-539882a2-0fc3-4068-89a4-80479c0ef8e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.164461] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.164637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.165475] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.165475] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.165475] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.165475] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66059812-5f73-418f-ad78-6bf59383a388 is going to be updated. [ 985.191487] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.232223] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.232423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.232423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.232626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.232783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.250011] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66059812-5f73-418f-ad78-6bf59383a388 in Status: IN_PROGRESS for 2s [ 985.497880] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.694799] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.694799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.694799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.695230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.695374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.695644] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 985.735668] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.735812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.735883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.736114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.736261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.747974] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 985.822029] env[66730]: INFO networking_nsxv3.common.synchronization [req-1a4efdf4-b340-4e05-8c8e-cf6ff203f2ea req-0d98dfc4-016c-4379-b5b2-171b715e2c65 service nova] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 985.822214] env[66730]: INFO networking_nsxv3.common.synchronization [req-1a4efdf4-b340-4e05-8c8e-cf6ff203f2ea req-0d98dfc4-016c-4379-b5b2-171b715e2c65 service nova] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 985.822355] env[66730]: INFO networking_nsxv3.common.synchronization [req-1a4efdf4-b340-4e05-8c8e-cf6ff203f2ea req-0d98dfc4-016c-4379-b5b2-171b715e2c65 service nova] Enqueued Resource ID: 539882a2-0fc3-4068-89a4-80479c0ef8e5 with Priority: HIGHEST for action port [ 985.822911] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 985.823063] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 985.823203] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 539882a2-0fc3-4068-89a4-80479c0ef8e5 with Priority: HIGHEST for action port [ 985.823956] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.823956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.823956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.824225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.824323] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.826827] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.826968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.827419] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-539882a2-0fc3-4068-89a4-80479c0ef8e5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.827662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-539882a2-0fc3-4068-89a4-80479c0ef8e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.827662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-539882a2-0fc3-4068-89a4-80479c0ef8e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.828388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-539882a2-0fc3-4068-89a4-80479c0ef8e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.828504] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('539882a2-0fc3-4068-89a4-80479c0ef8e5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.999141] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.999302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.999370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.999645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.999752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.999980] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 is going to be updated. [ 986.036039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.036039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.036039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.036271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.036318] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.046441] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: IN_PROGRESS for 2s [ 986.326989] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.327371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.330560] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 539882a2-0fc3-4068-89a4-80479c0ef8e5 with status ACTIVE [ 986.330784] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.330911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.330976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.331225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.331320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.331506] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.331607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.331671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.331856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.332025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.332212] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.332305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.332367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.332507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.332579] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.332663] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 539882a2-0fc3-4068-89a4-80479c0ef8e5 is going to be updated. [ 986.355264] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.355414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.355478] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.355763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.355903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.356085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-539882a2-0fc3-4068-89a4-80479c0ef8e5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.668190] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 986.668190] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba deletion is rescheduled due to dependency. [ 986.668190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.668190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.668190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.668190] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.668190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.668509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.668509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.668509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.668606] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.751568] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: SUCCESS [ 986.751745] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 deletion is rescheduled due to dependency. [ 986.751898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.752249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.752336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.752518] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.752632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.752695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.752844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.752924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.753016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.753118] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.753970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.755405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.755585] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.755698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.755762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.755910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.755992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.756094] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.171511] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.235176] env[66730]: INFO networking_nsxv3.common.synchronization [None req-d18f5f02-6227-49b8-adc4-9f749dd92315 tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: ea5a18a7-797c-44ef-88a1-1daaca34ff96 with Priority: HIGHEST for action security_group_rules [ 987.235723] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5a18a7-797c-44ef-88a1-1daaca34ff96 with Priority: HIGHEST for action security_group_rules [ 987.236031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea5a18a7-797c-44ef-88a1-1daaca34ff96 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.236325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea5a18a7-797c-44ef-88a1-1daaca34ff96" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.236435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea5a18a7-797c-44ef-88a1-1daaca34ff96" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.236712] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea5a18a7-797c-44ef-88a1-1daaca34ff96" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.236815] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea5a18a7-797c-44ef-88a1-1daaca34ff96',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.258900] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.263025] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.263025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.263025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.263025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.263025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.263025] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.263025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.263025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.263025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.263025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.263025] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 is going to be updated. [ 987.263807] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66059812-5f73-418f-ad78-6bf59383a388 in Status: SUCCESS [ 987.264116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.264383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.264651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.264903] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.265139] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.265279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.265500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.265673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.265837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.266030] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66059812-5f73-418f-ad78-6bf59383a388',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.267336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.267635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.267890] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.268210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.268360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.268585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.268763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.268941] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66059812-5f73-418f-ad78-6bf59383a388',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.306955] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.306955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.306955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.306955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.306955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.320346] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: IN_PROGRESS for 2s [ 987.336588] env[66730]: INFO networking_nsxv3.common.synchronization [None req-c21f1049-15a8-4de0-85ed-2ed0cffa6437 tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: ea5a18a7-797c-44ef-88a1-1daaca34ff96 with Priority: HIGHEST for action security_group_rules [ 987.337160] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5a18a7-797c-44ef-88a1-1daaca34ff96 with Priority: HIGHEST for action security_group_rules [ 987.337952] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea5a18a7-797c-44ef-88a1-1daaca34ff96 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.338093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea5a18a7-797c-44ef-88a1-1daaca34ff96" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.674816] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.759133] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 987.759354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.759543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.759968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.760085] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.760182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.760245] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.760418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.760502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.760605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.760731] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.762570] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.762707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.762782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.762963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.763064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.763206] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea5a18a7-797c-44ef-88a1-1daaca34ff96 already deleted. [ 987.763282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea5a18a7-797c-44ef-88a1-1daaca34ff96" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.763469] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121: rpc.has_security_group_logging(os_id): False [ 987.764467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.764662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.764845] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.764962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.765134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.765178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.767086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.767195] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.768521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea5a18a7-797c-44ef-88a1-1daaca34ff96" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.768521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea5a18a7-797c-44ef-88a1-1daaca34ff96" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.768521] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea5a18a7-797c-44ef-88a1-1daaca34ff96',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.770238] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66059812-5f73-418f-ad78-6bf59383a388',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.774056] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.774056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.774056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.774056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.774056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.774056] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.774056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.774056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.774056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.774056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.774056] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66059812-5f73-418f-ad78-6bf59383a388 is going to be deleted. [ 987.789990] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.789990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.789990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.789990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.789990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.789990] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.789990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.789990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.789990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.789990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.789990] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 is going to be updated. [ 987.819136] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.819521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.819521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.819907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.820080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.820139] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.860522] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.860522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.860522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.860522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.860782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.873822] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: IN_PROGRESS for 2s [ 988.061283] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: SUCCESS [ 988.061283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.061283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.061283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.062085] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.062085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.062085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.062085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.062085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.062085] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.178440] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.178440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.178440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.178440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.178662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.178662] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 988.236445] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.236445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.236445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.236445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.236445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.251593] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 988.271334] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.271631] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.276128] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.277515] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66059812-5f73-418f-ad78-6bf59383a388: rpc.has_security_group_logging(os_id): False [ 988.318821] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.319040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.319148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.319390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.319516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.319950] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.320054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.320112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.320349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.320349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.320447] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66059812-5f73-418f-ad78-6bf59383a388 is going to be created. [ 988.322491] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.322649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.322685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.322882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.323033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.323166] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea5a18a7-797c-44ef-88a1-1daaca34ff96 already deleted. [ 988.323302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea5a18a7-797c-44ef-88a1-1daaca34ff96" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.354748] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/66059812-5f73-418f-ad78-6bf59383a388], does not exist path=[/infra/domains/default/groups/66059812-5f73-418f-ad78-6bf59383a388]."\n}' [ 988.355120] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66059812-5f73-418f-ad78-6bf59383a388 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/66059812-5f73-418f-ad78-6bf59383a388 [ 988.355120] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 988.413200] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.413200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.413200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.413200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.414186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.414499] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.414608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.414675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.414971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.414971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.415182] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.415257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.415294] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.415454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.415497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.415587] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66059812-5f73-418f-ad78-6bf59383a388 is going to be created. [ 988.437289] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/66059812-5f73-418f-ad78-6bf59383a388], does not exist path=[/infra/domains/default/groups/66059812-5f73-418f-ad78-6bf59383a388]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/66059812-5f73-418f-ad78-6bf59383a388 [ 988.437474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66059812-5f73-418f-ad78-6bf59383a388" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.437689] env[66730]: Traceback (most recent call last): [ 988.437733] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 988.437733] env[66730]: return func(*args, **kwargs) [ 988.437733] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 988.437733] env[66730]: res.raise_for_status() [ 988.437733] env[66730]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 988.437733] env[66730]: raise HTTPError(http_error_msg, response=self) [ 988.437733] env[66730]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/66059812-5f73-418f-ad78-6bf59383a388 [ 988.437733] env[66730]: During handling of the above exception, another exception occurred: [ 988.437733] env[66730]: Traceback (most recent call last): [ 988.438010] env[66730]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 988.438010] env[66730]: listener.cb(fileno) [ 988.438010] env[66730]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 988.438010] env[66730]: result = function(*args, **kwargs) [ 988.438010] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 988.438010] env[66730]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 988.438010] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 988.438010] env[66730]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 988.438010] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 988.438010] env[66730]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 988.438010] env[66730]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 988.438010] env[66730]: res.raise_for_status() [ 988.438010] env[66730]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 988.438010] env[66730]: raise HTTPError(http_error_msg, response=self) [ 988.438010] env[66730]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/66059812-5f73-418f-ad78-6bf59383a388 [ 988.438010] env[66730]: Removing descriptor: 60 [ 988.564033] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.780254] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.008938] env[66730]: INFO networking_nsxv3.common.synchronization [req-c347db00-9c8d-450d-94aa-e17fb42bf003 req-ab208529-f6cd-41f7-8589-17f17fa9aef3 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 989.009429] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 989.009857] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.010086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.010086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.010355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.010693] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.010944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.010944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.011145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.011244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.011570] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.070707] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.284683] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.284934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.284992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.285223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.285310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.285410] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 989.339238] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: SUCCESS [ 989.339238] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 deletion is rescheduled due to dependency. [ 989.339238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.360030] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.360030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.360030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.360030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.360030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.372105] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 989.406510] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.406812] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.407026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.407545] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.407957] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.408211] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.408387] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.408726] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.408939] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.409271] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.409458] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.409643] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.409803] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.409995] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.410171] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.410390] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.435614] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.435818] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 989.436033] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.436147] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.436528] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-b4044cc6-9306-411e-ac4a-18fd86d6c8c5 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.436886] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-b4044cc6-9306-411e-ac4a-18fd86d6c8c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.436886] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-b4044cc6-9306-411e-ac4a-18fd86d6c8c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.437288] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-b4044cc6-9306-411e-ac4a-18fd86d6c8c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.437431] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4044cc6-9306-411e-ac4a-18fd86d6c8c5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.514154] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.514270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.514307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.514544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.514671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.514897] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.515052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.515145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.515334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.515434] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.515544] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 already deleted. [ 989.515647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.574019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.574195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.574195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.574385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.574435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.574558] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 is going to be updated. [ 989.608796] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.609010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.609179] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.609375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.609552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.620790] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: IN_PROGRESS for 2s [ 989.892652] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 in Status: SUCCESS [ 989.892803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.941047] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.942042] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.942211] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.942688] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.942984] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.943339] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port b4044cc6-9306-411e-ac4a-18fd86d6c8c5 not found, creating... [ 989.943926] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.944220] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.944501] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.944856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.945114] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.945519] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.945747] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.946060] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.946453] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.946713] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.946948] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: b4044cc6-9306-411e-ac4a-18fd86d6c8c5 is going to be created. [ 989.972923] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.973167] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.973303] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.973568] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.973795] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.974034] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-b4044cc6-9306-411e-ac4a-18fd86d6c8c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.273070] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 990.273457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.273735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.273984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.274197] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.274340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.274421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.274605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.274692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.274792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.274928] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.718595] env[66730]: INFO networking_nsxv3.common.synchronization [req-c347db00-9c8d-450d-94aa-e17fb42bf003 req-d61adea8-3d92-411d-8a0b-33b0c62ec538 service nova] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_rules [ 990.718860] env[66730]: INFO networking_nsxv3.common.synchronization [req-c347db00-9c8d-450d-94aa-e17fb42bf003 req-d61adea8-3d92-411d-8a0b-33b0c62ec538 service nova] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 990.718931] env[66730]: INFO networking_nsxv3.common.synchronization [req-c347db00-9c8d-450d-94aa-e17fb42bf003 req-d61adea8-3d92-411d-8a0b-33b0c62ec538 service nova] Enqueued Resource ID: b4044cc6-9306-411e-ac4a-18fd86d6c8c5 with Priority: HIGHEST for action port [ 990.719415] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_rules [ 990.719547] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 990.720254] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4044cc6-9306-411e-ac4a-18fd86d6c8c5 with Priority: HIGHEST for action port [ 990.720254] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.720254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.720426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.720515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.720602] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.721466] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.721579] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.721651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.721816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.721959] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.722057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.722117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.722251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.722327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.722411] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.723155] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4044cc6-9306-411e-ac4a-18fd86d6c8c5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.723253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4044cc6-9306-411e-ac4a-18fd86d6c8c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.723315] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4044cc6-9306-411e-ac4a-18fd86d6c8c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.723668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4044cc6-9306-411e-ac4a-18fd86d6c8c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.723668] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4044cc6-9306-411e-ac4a-18fd86d6c8c5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.777176] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.046875] env[66730]: INFO networking_nsxv3.common.synchronization [req-2b76a9eb-a583-437f-b0e2-d9d8ef596ace req-628f0b83-8248-4d36-89d4-f7ef0df7a4a4 tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 991.047334] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 991.047736] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.047862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.047924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.048532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.048532] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.048532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.048829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.048829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.048829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.048968] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.225799] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.225799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.226668] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.227826] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4044cc6-9306-411e-ac4a-18fd86d6c8c5 with status ACTIVE [ 991.227826] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.227994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.228069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.228276] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.228446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.228692] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.228796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.228881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.229112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.229112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.229324] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.229486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.229486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.229660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.229816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.229875] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4044cc6-9306-411e-ac4a-18fd86d6c8c5 is going to be updated. [ 991.258650] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.258883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.258962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.259199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.259327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.259484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4044cc6-9306-411e-ac4a-18fd86d6c8c5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.281944] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a55c2a9-6077-4f76-8e80-8d941329a6ba: rpc.has_security_group_logging(os_id): False [ 991.309356] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.310141] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.311016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.311016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.339106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.339956] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.339956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.339956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.339956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.340224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.340224] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 991.382438] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 991.382699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.382903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.383172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.383362] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.383481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.383546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.383789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.383868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.383951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.384147] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.384295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.384376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.384539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.384688] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.384779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.384840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.384976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.385059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.385142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.385228] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.440547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.440757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.440855] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.441196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.441426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.477046] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 991.551940] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.552228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.552496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.552863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.595434] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.595727] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.595859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.595935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.596167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.596258] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.596360] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 991.636268] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: SUCCESS [ 991.636456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.636628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.636851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.637050] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.637168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.637234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.637394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.637472] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.637556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.637727] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.637837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.637876] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.638012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.638163] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.638493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.638572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.638746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.638864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.638997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.639149] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.641528] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.641528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.641528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.641725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.641763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.651811] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 991.734389] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.889136] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16d1896c-4d80-4a01-9c49-a61403e196c4: rpc.has_security_group_logging(os_id): False [ 991.909115] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.909115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.909115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.909115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.933889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.934368] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.934508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.934611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.934820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.935201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.935475] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.935592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.935660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.935836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.936157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.936395] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.936499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.936569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.936724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.936806] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.936896] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 992.006045] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.006191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.006274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.006873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.006873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.031322] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 992.144755] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74d582a7-b8c7-4980-ad04-779d4df3e481: rpc.has_security_group_logging(os_id): False [ 992.167395] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.167650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.167801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.168165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.168325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.168666] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.168856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.168979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.169288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.169446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.169789] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.169944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.170079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.170324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.170488] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.170812] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.170982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.171133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.171372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.171516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.171696] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 is going to be created. [ 992.237022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.237288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.237367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.237652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.237759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.237886] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 is going to be created. [ 992.251913] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.252181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.252181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.252440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.252683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.283600] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.283815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.283925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.284255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.284471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.290387] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: IN_PROGRESS for 2s [ 992.309858] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: UNINITIALIZED for 2s [ 993.491060] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 993.491898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.667232] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 993.667406] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 deletion is rescheduled due to dependency. [ 993.667556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.031528] env[66730]: INFO networking_nsxv3.common.synchronization [req-c316e435-4101-4482-8c54-915ffba8c409 req-d1e30d79-3e08-4e51-8fca-bbc270c59c29 tempest-ServerActionsV293TestJSON-1968079804 tempest-ServerActionsV293TestJSON-1968079804-project-member] Enqueued Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_members [ 994.033028] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_members [ 994.033347] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d435b8d7-20a4-46cb-ab34-d523daf07ab7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.033462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.033525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.033910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.034116] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.034417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.034417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.034485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.034515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.034600] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.051834] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 994.051834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.310680] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: SUCCESS [ 994.310848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.312748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.312748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.312748] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.324019] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: SUCCESS [ 994.324258] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.324457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.324639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.324829] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.324948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.325038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.325175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.325253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.325334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.325421] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.541574] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.541917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.541917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.542203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.542331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.542611] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.542746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.542830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.544242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.544242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.544242] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 already deleted. [ 994.544242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.818545] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.818839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.818839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.819007] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.819640] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.819749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.819749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.820266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.820266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.820266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.820266] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.827938] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.869328] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.869660] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-916" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.869754] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-916" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.870174] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-916" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.870546] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.870860] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.870926] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.871179] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.871395] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.871571] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.871734] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.871861] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.872085] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.872203] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.872326] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.872514] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.897764] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.898445] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.898445] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.898445] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-916" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.898777] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-b8809bd0-cfb8-40a9-8c0a-367d3fec13e6 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.899080] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-b8809bd0-cfb8-40a9-8c0a-367d3fec13e6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.899421] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-b8809bd0-cfb8-40a9-8c0a-367d3fec13e6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.899595] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-b8809bd0-cfb8-40a9-8c0a-367d3fec13e6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.899806] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8809bd0-cfb8-40a9-8c0a-367d3fec13e6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.323506] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.323676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.323741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.323965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.324155] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.324254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.324317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.324464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.324547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.324632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.324780] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.324873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.324933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.325085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.325277] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.325371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.325425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.325560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.325633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.325713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.325803] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.331836] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 086ea73c-820f-4794-8c0e-90c25aca8f44: rpc.has_security_group_logging(os_id): False [ 995.351018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.351018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.351018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.351018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.351018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.351311] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.351311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.351399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.351508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.351576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.351666] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 is going to be created. [ 995.402718] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.402873] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.403059] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.403319] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.403523] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.403684] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port b8809bd0-cfb8-40a9-8c0a-367d3fec13e6 not found, creating... [ 995.403941] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.404113] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.404296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.404456] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.404590] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.404878] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.405035] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.405153] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.405399] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.405533] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.405673] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: b8809bd0-cfb8-40a9-8c0a-367d3fec13e6 is going to be created. [ 995.413412] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.413625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.413694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.413920] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.414122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.428787] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: IN_PROGRESS for 2s [ 995.431431] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.431622] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.431746] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.432045] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.432283] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.432502] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-b8809bd0-cfb8-40a9-8c0a-367d3fec13e6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.827864] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74d582a7-b8c7-4980-ad04-779d4df3e481: rpc.has_security_group_logging(os_id): False [ 995.847899] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.848122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.848167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.848370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.848456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.848812] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.848812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.848812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.848942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.849097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.849211] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.849370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.849370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.849496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.849567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.849816] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.849914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.850137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.850379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.850517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.850651] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 is going to be updated. [ 995.912428] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.912822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.913459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.914348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.914441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.930244] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: IN_PROGRESS for 2s [ 996.171197] env[66730]: INFO networking_nsxv3.common.synchronization [req-c316e435-4101-4482-8c54-915ffba8c409 req-6b9e9acc-ad24-457e-9d93-de92249d2824 service nova] Enqueued Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_rules [ 996.171197] env[66730]: INFO networking_nsxv3.common.synchronization [req-c316e435-4101-4482-8c54-915ffba8c409 req-6b9e9acc-ad24-457e-9d93-de92249d2824 service nova] Enqueued Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_members [ 996.171197] env[66730]: INFO networking_nsxv3.common.synchronization [req-c316e435-4101-4482-8c54-915ffba8c409 req-6b9e9acc-ad24-457e-9d93-de92249d2824 service nova] Enqueued Resource ID: b8809bd0-cfb8-40a9-8c0a-367d3fec13e6 with Priority: HIGHEST for action port [ 996.174402] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_rules [ 996.174563] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_members [ 996.174667] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8809bd0-cfb8-40a9-8c0a-367d3fec13e6 with Priority: HIGHEST for action port [ 996.175267] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.175396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.175463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.175709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.175793] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.177505] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d435b8d7-20a4-46cb-ab34-d523daf07ab7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.177505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.177505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.177505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.177505] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.177828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.177828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.177948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.177948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.178041] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.178948] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8809bd0-cfb8-40a9-8c0a-367d3fec13e6 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.179489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8809bd0-cfb8-40a9-8c0a-367d3fec13e6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.179489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8809bd0-cfb8-40a9-8c0a-367d3fec13e6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.179489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8809bd0-cfb8-40a9-8c0a-367d3fec13e6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.179489] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8809bd0-cfb8-40a9-8c0a-367d3fec13e6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.506957] env[66730]: INFO networking_nsxv3.common.synchronization [req-4f246031-dbb0-4b13-abb9-a394657afb4d req-9d97973c-e795-47a5-820c-fe247df4cdec tempest-ImagesTestJSON-681326034 tempest-ImagesTestJSON-681326034-project-member] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 996.507146] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 996.507487] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.508126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.508126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.508249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.508330] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.509210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.509210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.509210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.509210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.509210] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.681237] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.682484] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d435b8d7-20a4-46cb-ab34-d523daf07ab7 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.682632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.683722] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8809bd0-cfb8-40a9-8c0a-367d3fec13e6 with status ACTIVE [ 996.683722] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.683722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.683722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.683722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.683722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.683722] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.684060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.684060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.684060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.684060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.684723] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.684831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.684923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.685096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.685176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.685210] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8809bd0-cfb8-40a9-8c0a-367d3fec13e6 is going to be updated. [ 996.711770] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.711770] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.711770] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.712025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.715019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.715019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8809bd0-cfb8-40a9-8c0a-367d3fec13e6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.929341] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-777 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.929761] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.929761] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.929987] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.930268] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.930422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.930534] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.930763] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.930919] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.931140] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.931254] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.931373] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.931483] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.931591] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.931697] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.931832] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.950026] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.950195] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 996.950330] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.950495] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.950861] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-9fa3e52a-db0f-449f-b7f1-5ded9f2c0016 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.951044] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-9fa3e52a-db0f-449f-b7f1-5ded9f2c0016" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.951167] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-9fa3e52a-db0f-449f-b7f1-5ded9f2c0016" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.951493] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-9fa3e52a-db0f-449f-b7f1-5ded9f2c0016" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.951635] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fa3e52a-db0f-449f-b7f1-5ded9f2c0016',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.010677] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.010864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.010904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.011152] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.034480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.034740] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.034950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.034950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.035144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.035237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.035317] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 997.061603] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.061796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.061838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.062061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.062205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.072529] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 997.183934] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.441697] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: SUCCESS [ 997.441913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.454222] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.454451] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.454608] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.454897] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.455058] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.455220] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 9fa3e52a-db0f-449f-b7f1-5ded9f2c0016 not found, creating... [ 997.455483] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.455643] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.455758] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.456079] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.456210] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.456429] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.456586] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.456701] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.456909] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.457059] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.457215] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 9fa3e52a-db0f-449f-b7f1-5ded9f2c0016 is going to be created. [ 997.479577] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.479895] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.480020] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.480378] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.480710] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.480951] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-9fa3e52a-db0f-449f-b7f1-5ded9f2c0016" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.688225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.688409] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.688480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.688725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.688812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.688914] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 is going to be created. [ 997.721102] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.721269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.721310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.722121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.722121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.731907] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 in Status: UNINITIALIZED for 2s [ 997.951684] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: SUCCESS [ 997.952133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.291107] env[66730]: INFO networking_nsxv3.common.synchronization [req-4f246031-dbb0-4b13-abb9-a394657afb4d req-02ce81ff-5ed0-465d-ac3e-cd712a1545e1 service nova] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_rules [ 998.291352] env[66730]: INFO networking_nsxv3.common.synchronization [req-4f246031-dbb0-4b13-abb9-a394657afb4d req-02ce81ff-5ed0-465d-ac3e-cd712a1545e1 service nova] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 998.291532] env[66730]: INFO networking_nsxv3.common.synchronization [req-4f246031-dbb0-4b13-abb9-a394657afb4d req-02ce81ff-5ed0-465d-ac3e-cd712a1545e1 service nova] Enqueued Resource ID: 9fa3e52a-db0f-449f-b7f1-5ded9f2c0016 with Priority: HIGHEST for action port [ 998.292227] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_rules [ 998.292416] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 998.292524] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa3e52a-db0f-449f-b7f1-5ded9f2c0016 with Priority: HIGHEST for action port [ 998.292915] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.293080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.293349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.293428] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.293539] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.294690] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.295556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.295915] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fa3e52a-db0f-449f-b7f1-5ded9f2c0016 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.296107] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fa3e52a-db0f-449f-b7f1-5ded9f2c0016" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.296216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fa3e52a-db0f-449f-b7f1-5ded9f2c0016" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.296515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fa3e52a-db0f-449f-b7f1-5ded9f2c0016" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.296640] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fa3e52a-db0f-449f-b7f1-5ded9f2c0016',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.799868] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.800084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.800256] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fa3e52a-db0f-449f-b7f1-5ded9f2c0016 with status ACTIVE [ 998.800377] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.800534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.800534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.800784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.800851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.801079] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.801165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.801200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.801729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.801860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.802108] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.802215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.802310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.802521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.803195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.803314] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fa3e52a-db0f-449f-b7f1-5ded9f2c0016 is going to be updated. [ 998.837138] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.837413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.837576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.837949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.838245] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.838523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fa3e52a-db0f-449f-b7f1-5ded9f2c0016" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.082646] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 999.083037] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 deletion is rescheduled due to dependency. [ 999.083037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.083125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.083347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.083527] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.083640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.083709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.083916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.083959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.084064] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.586355] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.742254] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 in Status: SUCCESS [ 999.742396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.742624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.742851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.743134] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.743375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.743375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.743489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.743558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.743640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.743728] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.089291] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.245633] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.592302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.592551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.592551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.593337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.593337] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.593337] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1000.627295] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.627535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.627535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.627808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.627998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.640451] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1000.748524] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d435b8d7-20a4-46cb-ab34-d523daf07ab7: rpc.has_security_group_logging(os_id): False [ 1000.768060] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.768060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.768060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.768060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.768060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.768420] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.768420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.768420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.768548] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.768769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.768953] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 is going to be created. [ 1000.849035] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.849035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.849035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.849035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.849035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.860270] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 in Status: IN_PROGRESS for 2s [ 1002.656180] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1002.656549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.656549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.656776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.656995] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.657186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.657186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.657503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.657503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.657503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.657618] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.877275] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 in Status: SUCCESS [ 1002.877544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.160495] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.160834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.160834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.161099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.161420] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.161564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.161564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.161685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.161794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.161910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.162099] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.162374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.162374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.162569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.162752] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.162897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.162972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.163215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.163335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.163448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.163577] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.294812] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1003.294812] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1003.665719] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a7c2214-9790-410b-aab0-021836529ff9: rpc.has_security_group_logging(os_id): False [ 1003.701664] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.701817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.701907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.702220] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.702349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.702660] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.702846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.702940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.703190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.703321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.703567] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.703704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.703791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.703982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.704103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.704380] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.704500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.704616] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.704755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.704859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.705049] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1003.742618] env[66730]: INFO networking_nsxv3.common.synchronization [req-2b200fb7-4e4b-45f8-9171-958c36680d3d req-a1cf2e9e-7ee1-45ce-b373-5f3a6c7fa7d7 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1003.743485] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1003.743614] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.743677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.743723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.743931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.746709] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.747592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.747592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.747592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.747592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.747592] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.812219] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.812573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.812793] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.813115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.813300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.843383] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1004.249927] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.250046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.250087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.250326] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.271540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.271835] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.272067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.272138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.272352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.272474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.272618] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1004.309506] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.312904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.313026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.316833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.317093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.335150] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1005.742415] env[66730]: INFO networking_nsxv3.common.synchronization [req-0f1c02ce-d685-4607-b740-95838c6f36bf req-c50237d8-acc3-4b22-bdbc-3cf15b22d570 tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_members [ 1005.742991] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGHEST for action security_group_members [ 1005.743447] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5161856-541b-4ad9-a7f2-629e78702077 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.743570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.743620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.743830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.743987] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.744105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.744169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.744324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.744414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.744507] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.868900] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1005.869213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.248775] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.249037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.249037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.249330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.272704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.272973] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.273113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.273187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.273396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.273484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.273576] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5161856-541b-4ad9-a7f2-629e78702077 is going to be updated. [ 1006.310343] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.310626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.310626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.311296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.311296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.322063] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5161856-541b-4ad9-a7f2-629e78702077 in Status: IN_PROGRESS for 2s [ 1006.332640] env[66730]: INFO networking_nsxv3.common.synchronization [req-29b09887-9ba2-4ed4-8719-fdfc5f27b1fe req-0178974e-bf5a-44fb-8b6f-21afe60c9486 tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1006.332640] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1006.333438] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.333892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.334215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.335162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.336246] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.336246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.336246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.337480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.337480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.337480] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.352952] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1006.352952] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 1006.352952] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.818049] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.818959] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.818959] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.818959] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.819397] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.819856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.819856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.819985] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.820244] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.820552] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.820785] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.820960] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.821289] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.821356] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.821488] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.821786] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.841754] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.841966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.842042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.842265] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.842354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.842731] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.842863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.842863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.843060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.843141] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.843245] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 1006.849026] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.849026] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.849026] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.849026] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.849026] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-56e65394-f873-422a-8492-9e09efed4211 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.849418] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-56e65394-f873-422a-8492-9e09efed4211" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.849418] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-56e65394-f873-422a-8492-9e09efed4211" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.849752] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-56e65394-f873-422a-8492-9e09efed4211" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.849956] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56e65394-f873-422a-8492-9e09efed4211',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.879631] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.879631] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.879631] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.879631] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.879631] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.886966] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 1007.352863] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.353108] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.353240] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.353543] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.353701] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.353854] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 56e65394-f873-422a-8492-9e09efed4211 not found, creating... [ 1007.354124] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.354295] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.354405] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.354996] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.354996] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.355153] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.355337] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.355511] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.355708] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.355918] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.356047] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 56e65394-f873-422a-8492-9e09efed4211 is going to be created. [ 1007.377635] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.377961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.378099] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.378374] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.378603] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.378850] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-56e65394-f873-422a-8492-9e09efed4211" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.123556] env[66730]: INFO networking_nsxv3.common.synchronization [req-29b09887-9ba2-4ed4-8719-fdfc5f27b1fe req-7c1c676b-22b1-4fc1-9626-531036fbb841 service nova] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_rules [ 1008.123556] env[66730]: INFO networking_nsxv3.common.synchronization [req-29b09887-9ba2-4ed4-8719-fdfc5f27b1fe req-7c1c676b-22b1-4fc1-9626-531036fbb841 service nova] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1008.123556] env[66730]: INFO networking_nsxv3.common.synchronization [req-29b09887-9ba2-4ed4-8719-fdfc5f27b1fe req-7c1c676b-22b1-4fc1-9626-531036fbb841 service nova] Enqueued Resource ID: 56e65394-f873-422a-8492-9e09efed4211 with Priority: HIGHEST for action port [ 1008.123959] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_rules [ 1008.124297] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1008.124412] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56e65394-f873-422a-8492-9e09efed4211 with Priority: HIGHEST for action port [ 1008.124769] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.124993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.125132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.125372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.125488] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.126528] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.126711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.126966] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-56e65394-f873-422a-8492-9e09efed4211 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.127121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56e65394-f873-422a-8492-9e09efed4211" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.127263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56e65394-f873-422a-8492-9e09efed4211" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.127525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56e65394-f873-422a-8492-9e09efed4211" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.127630] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56e65394-f873-422a-8492-9e09efed4211',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.176042] env[66730]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1008.176042] env[66730]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1008.337782] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5161856-541b-4ad9-a7f2-629e78702077 in Status: SUCCESS [ 1008.337983] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5161856-541b-4ad9-a7f2-629e78702077 deletion is rescheduled due to dependency. [ 1008.338103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.631103] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.631103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.631103] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56e65394-f873-422a-8492-9e09efed4211 with status ACTIVE [ 1008.631103] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.631103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.631103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.631103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.631103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.631103] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.631103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.631103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.631775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.631775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.631775] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.631775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.631775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.631775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.632015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.632015] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56e65394-f873-422a-8492-9e09efed4211 is going to be updated. [ 1008.659231] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.659231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.659231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.659231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.659231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.659231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56e65394-f873-422a-8492-9e09efed4211" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.914053] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 1008.914053] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 deletion is rescheduled due to dependency. [ 1008.914053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.914053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.914053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.914053] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.914053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.914053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.914053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.914053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.914644] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.928861] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.929084] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.929221] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.929576] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.929885] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.930083] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.930316] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.930441] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.930638] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.930815] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.930936] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.931057] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.931164] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.931289] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.931394] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.931537] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.952220] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.952557] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1008.952682] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.952934] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-106" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.953341] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-f672860b-57b8-4ee0-90d2-fd621c751e75 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.953596] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.953756] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.954151] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.954323] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f672860b-57b8-4ee0-90d2-fd621c751e75',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.417039] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.457681] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.457914] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.458084] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.458373] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.458522] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.458811] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.458969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.459100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.459330] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.459484] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.459906] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.460137] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.460264] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.460491] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.460629] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.460781] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: f672860b-57b8-4ee0-90d2-fd621c751e75 is going to be updated. [ 1009.483775] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.483992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.484110] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.484513] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.484637] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.484849] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.919361] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.208176] env[66730]: INFO networking_nsxv3.common.synchronization [req-8235f760-1a2d-4227-a056-85e78a45aa99 req-b9a232fc-c389-441a-859f-0430c25eeda4 service nova] Enqueued Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_rules [ 1010.208363] env[66730]: INFO networking_nsxv3.common.synchronization [req-8235f760-1a2d-4227-a056-85e78a45aa99 req-b9a232fc-c389-441a-859f-0430c25eeda4 service nova] Enqueued Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_members [ 1010.208501] env[66730]: INFO networking_nsxv3.common.synchronization [req-8235f760-1a2d-4227-a056-85e78a45aa99 req-b9a232fc-c389-441a-859f-0430c25eeda4 service nova] Enqueued Resource ID: f672860b-57b8-4ee0-90d2-fd621c751e75 with Priority: HIGHEST for action port [ 1010.209021] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_rules [ 1010.209161] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_members [ 1010.209286] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f672860b-57b8-4ee0-90d2-fd621c751e75 with Priority: HIGHEST for action port [ 1010.209564] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.209722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.209786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.210680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.212623] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.213421] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.213546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.213618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.213788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.213980] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.214391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.214486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.214613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.214695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.216010] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.218217] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-f672860b-57b8-4ee0-90d2-fd621c751e75 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.218411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.218522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.219194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.219194] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f672860b-57b8-4ee0-90d2-fd621c751e75',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.421998] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.422321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.423085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.423356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.424358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.424564] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 1010.459509] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.459745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.460131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.460131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.460318] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.469609] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 1010.721609] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.722756] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.724659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.726507] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f672860b-57b8-4ee0-90d2-fd621c751e75 with status ACTIVE [ 1010.727262] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.728251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.729013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.729257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.729614] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.729973] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.730466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.730646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.731127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.731216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.731417] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.731622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.731698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.731927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.732046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.732113] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f672860b-57b8-4ee0-90d2-fd621c751e75 is going to be updated. [ 1010.755847] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.756017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.756131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.756256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.756383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.756539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f672860b-57b8-4ee0-90d2-fd621c751e75" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.227280] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.635198] env[66730]: INFO networking_nsxv3.common.synchronization [req-850b296b-44b5-49a1-8656-00bfcb69edba req-263ff1fc-64c3-4f1b-8ed3-86369cd557bb tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: b5a2ec48-323c-4685-a7de-26d245ffe466 with Priority: HIGHEST for action security_group_members [ 1011.635573] env[66730]: INFO networking_nsxv3.common.synchronization [req-850b296b-44b5-49a1-8656-00bfcb69edba req-263ff1fc-64c3-4f1b-8ed3-86369cd557bb tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_members [ 1011.635573] env[66730]: INFO networking_nsxv3.common.synchronization [req-850b296b-44b5-49a1-8656-00bfcb69edba req-263ff1fc-64c3-4f1b-8ed3-86369cd557bb tempest-SecurityGroupsTestJSON-1233385564 tempest-SecurityGroupsTestJSON-1233385564-project-member] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 1011.635990] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a2ec48-323c-4685-a7de-26d245ffe466 with Priority: HIGHEST for action security_group_members [ 1011.638180] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb with Priority: HIGHEST for action security_group_members [ 1011.638296] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGHEST for action security_group_members [ 1011.638917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a2ec48-323c-4685-a7de-26d245ffe466 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.641021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.641021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.641021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.641021] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.641021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.641021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.641021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.641021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.641021] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.641622] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.641622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.641622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.641796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.641904] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.641984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.642395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.642559] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.642640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.642729] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a42262f2-f569-4e53-9e7f-cce89b9f6ecb',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.643544] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.643670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.643735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.643875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.644023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.644113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.644170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.644300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.644381] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.644461] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.732503] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.732503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.732503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.732503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.732503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.732503] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 is going to be updated. [ 1011.766286] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.767305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.767386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.767659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.767849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.780717] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: IN_PROGRESS for 2s [ 1011.967341] env[66730]: INFO networking_nsxv3.common.synchronization [req-037b7d61-f1c5-4c4f-915f-a82db5cbd917 req-af903446-4a41-41b6-944d-979bbfbcb756 tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1011.967341] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1011.967341] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.967341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.967341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.967551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.967657] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.967762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.967820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.967967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.968057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.968147] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.146474] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.147067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.147067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.147067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.148343] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.148546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.149547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.149547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.176421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.176696] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.176824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.176903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.177115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.177198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.177290] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb is going to be updated. [ 1012.178255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.178428] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.209995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.209995] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.209995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.209995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.210250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.210250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.210311] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a2ec48-323c-4685-a7de-26d245ffe466 is going to be updated. [ 1012.211412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.211545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.211625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.211804] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.211907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.211964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.214491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.214592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.214668] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be updated. [ 1012.219065] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.219183] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.219221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.219406] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.221978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.231729] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: IN_PROGRESS for 2s [ 1012.252026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.252026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.252026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.252026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.252026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.252026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.252026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.252026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.252026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.252026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.269592] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: IN_PROGRESS for 2s [ 1012.271717] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a2ec48-323c-4685-a7de-26d245ffe466 in Status: IN_PROGRESS for 2s [ 1012.447089] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-223 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.449435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.449435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.449435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.449435] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.449435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.449435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.449435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.449435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.449435] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.449435] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.449435] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.449435] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.449435] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.449435] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.451252] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.470877] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.471081] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.471211] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.472442] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.472442] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-2729ffc4-b153-4c3a-ae2d-4a0cff4781c1 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.472442] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-2729ffc4-b153-4c3a-ae2d-4a0cff4781c1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.472442] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-2729ffc4-b153-4c3a-ae2d-4a0cff4781c1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.472692] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-2729ffc4-b153-4c3a-ae2d-4a0cff4781c1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.472692] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2729ffc4-b153-4c3a-ae2d-4a0cff4781c1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.474748] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.483945] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 1012.483945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.483945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.483945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.484417] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.484555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.484623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.484789] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.484870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.484955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.485070] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.977805] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.977805] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.977805] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.978503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.978503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.978503] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 2729ffc4-b153-4c3a-ae2d-4a0cff4781c1 not found, creating... [ 1012.982274] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.982436] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.982556] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.982831] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.982978] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.983304] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.983458] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.983570] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.983789] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.983923] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.984076] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 2729ffc4-b153-4c3a-ae2d-4a0cff4781c1 is going to be created. [ 1012.985208] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.987938] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.988073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.988128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.988391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.988459] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.988552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.988615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.989039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.989039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.989039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.989039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.989364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.989364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.989364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.989503] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.989572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.989813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.989813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.989813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.990058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.990058] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.009891] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.010303] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.010303] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.010613] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.011282] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.011593] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-2729ffc4-b153-4c3a-ae2d-4a0cff4781c1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.488284] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.488605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.488605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.488843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.488968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.489166] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1013.491903] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f152db72-4e1f-4942-b241-530ee83d9bd1: rpc.has_security_group_logging(os_id): False [ 1013.515438] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.515613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.515681] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.515915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.516016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.516632] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.516632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.516632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.516632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.516632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.516871] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.516915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.516960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.517089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.517155] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.517331] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.517422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.517465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.517599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.517663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.517741] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 1013.540769] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.541026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.541026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.541266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.541404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.553498] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1013.607333] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.607544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.607739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.608037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.608595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.624827] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 1013.753943] env[66730]: INFO networking_nsxv3.common.synchronization [req-037b7d61-f1c5-4c4f-915f-a82db5cbd917 req-9c97b01c-e418-4589-a7ed-09646e5417d3 service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1013.754084] env[66730]: INFO networking_nsxv3.common.synchronization [req-037b7d61-f1c5-4c4f-915f-a82db5cbd917 req-9c97b01c-e418-4589-a7ed-09646e5417d3 service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1013.754221] env[66730]: INFO networking_nsxv3.common.synchronization [req-037b7d61-f1c5-4c4f-915f-a82db5cbd917 req-9c97b01c-e418-4589-a7ed-09646e5417d3 service nova] Enqueued Resource ID: 2729ffc4-b153-4c3a-ae2d-4a0cff4781c1 with Priority: HIGHEST for action port [ 1013.754796] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1013.755017] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1013.755226] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2729ffc4-b153-4c3a-ae2d-4a0cff4781c1 with Priority: HIGHEST for action port [ 1013.755569] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.755933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.755933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.756093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.756225] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.757505] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.758484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.758484] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-2729ffc4-b153-4c3a-ae2d-4a0cff4781c1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.758484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2729ffc4-b153-4c3a-ae2d-4a0cff4781c1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.758484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2729ffc4-b153-4c3a-ae2d-4a0cff4781c1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.758484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2729ffc4-b153-4c3a-ae2d-4a0cff4781c1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.758484] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2729ffc4-b153-4c3a-ae2d-4a0cff4781c1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.794959] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: SUCCESS [ 1013.794959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.794959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.794959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.794959] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.794959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.794959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.794959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.795515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.795515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.795515] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.248138] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb in Status: SUCCESS [ 1014.248489] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a42262f2-f569-4e53-9e7f-cce89b9f6ecb deletion is rescheduled due to dependency. [ 1014.248489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a42262f2-f569-4e53-9e7f-cce89b9f6ecb" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.260082] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.260271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.260463] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2729ffc4-b153-4c3a-ae2d-4a0cff4781c1 with status ACTIVE [ 1014.260653] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.260777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.260876] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.261101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.261191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.261361] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.261480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.261519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.261654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.261727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.261912] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.262011] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.262077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.262215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.262286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.262370] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2729ffc4-b153-4c3a-ae2d-4a0cff4781c1 is going to be updated. [ 1014.292494] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a2ec48-323c-4685-a7de-26d245ffe466 in Status: SUCCESS [ 1014.292742] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a2ec48-323c-4685-a7de-26d245ffe466 deletion is rescheduled due to dependency. [ 1014.292980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.294846] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 in Status: SUCCESS [ 1014.295020] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 deletion is rescheduled due to dependency. [ 1014.295123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.301295] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.318348] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.318461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.318461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.318666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.318804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.318973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2729ffc4-b153-4c3a-ae2d-4a0cff4781c1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.511306] env[66730]: INFO networking_nsxv3.common.synchronization [req-1553e5ab-a776-4017-b9ea-080b1bf5bc94 req-c30a3404-6c12-434b-96c4-25fad059ca83 tempest-ServerRescueTestJSON-513474333 tempest-ServerRescueTestJSON-513474333-project-member] Enqueued Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 1014.512370] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 1014.513485] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.513485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.513485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.513485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.513485] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.513895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.513895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.513895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.513895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.514093] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.803639] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fdb3ab9-9d8a-4975-a734-c0f1297bd452: rpc.has_security_group_logging(os_id): False [ 1014.837195] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.837649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.837649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.837926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.866394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.866915] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.867128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.867230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.867565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.867720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.867868] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 is going to be updated. [ 1014.957084] env[66730]: INFO networking_nsxv3.common.synchronization [None req-2b128dd9-3049-4431-8509-290e4249c386 None None] Enqueued Resource ID: bc4d5458-3f84-4413-8332-f767c18a5acc with Priority: HIGHEST for action port [ 1014.957084] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc4d5458-3f84-4413-8332-f767c18a5acc with Priority: HIGHEST for action port [ 1014.957084] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc4d5458-3f84-4413-8332-f767c18a5acc taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.958076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc4d5458-3f84-4413-8332-f767c18a5acc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.958076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc4d5458-3f84-4413-8332-f767c18a5acc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.958076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc4d5458-3f84-4413-8332-f767c18a5acc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.958278] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc4d5458-3f84-4413-8332-f767c18a5acc',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.961672] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.961967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.962217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.962588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.962893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.970195] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-650 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.970195] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-650" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.970195] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-650" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.972061] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-650" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.972061] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.972061] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.972061] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.972061] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.972557] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.973193] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.973193] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.973464] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.973744] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.974021] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.974294] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.975068] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.982183] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: IN_PROGRESS for 2s [ 1015.002241] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.002768] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.003194] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.003469] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-650" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.003916] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-e11d2a5d-915b-4b60-8866-205c931aa98d taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.004172] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-e11d2a5d-915b-4b60-8866-205c931aa98d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.004859] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-e11d2a5d-915b-4b60-8866-205c931aa98d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.004859] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-e11d2a5d-915b-4b60-8866-205c931aa98d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.004859] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e11d2a5d-915b-4b60-8866-205c931aa98d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.016796] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.467625] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc4d5458-3f84-4413-8332-f767c18a5acc [ 1015.467625] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.467625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.467625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.467625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.467625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.467625] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc4d5458-3f84-4413-8332-f767c18a5acc already deleted. [ 1015.467625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc4d5458-3f84-4413-8332-f767c18a5acc" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.513149] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.513149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.513149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.513149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.513149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.513149] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port e11d2a5d-915b-4b60-8866-205c931aa98d not found, creating... [ 1015.513149] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.513149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.513149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.513149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.513149] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.514330] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.514753] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.515073] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.515453] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.515745] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.516033] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: e11d2a5d-915b-4b60-8866-205c931aa98d is going to be created. [ 1015.521030] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.542449] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.542772] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.542861] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.543158] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.543413] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.543645] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-e11d2a5d-915b-4b60-8866-205c931aa98d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.567642] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1015.567978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.568157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.568392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.568582] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.568706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.568782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.568969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.568969] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.569131] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.674559] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 1015.676048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.023236] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.023434] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.023505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.023749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.023845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.023994] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae31dacc-8242-4331-8786-1526682530bd is going to be updated. [ 1016.058620] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.058620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.058984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.058984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.059263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.071187] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.073015] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: IN_PROGRESS for 2s [ 1016.290828] env[66730]: INFO networking_nsxv3.common.synchronization [req-1553e5ab-a776-4017-b9ea-080b1bf5bc94 req-31f21c18-3f0f-4a71-ac94-3034c7d474f7 service nova] Enqueued Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_rules [ 1016.290828] env[66730]: INFO networking_nsxv3.common.synchronization [req-1553e5ab-a776-4017-b9ea-080b1bf5bc94 req-31f21c18-3f0f-4a71-ac94-3034c7d474f7 service nova] Enqueued Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 1016.293170] env[66730]: INFO networking_nsxv3.common.synchronization [req-1553e5ab-a776-4017-b9ea-080b1bf5bc94 req-31f21c18-3f0f-4a71-ac94-3034c7d474f7 service nova] Enqueued Resource ID: e11d2a5d-915b-4b60-8866-205c931aa98d with Priority: HIGHEST for action port [ 1016.294135] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_rules [ 1016.294490] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 1016.294612] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e11d2a5d-915b-4b60-8866-205c931aa98d with Priority: HIGHEST for action port [ 1016.295067] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.295163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.295347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.295507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.295604] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.299578] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.299578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.299578] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-e11d2a5d-915b-4b60-8866-205c931aa98d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.299578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e11d2a5d-915b-4b60-8866-205c931aa98d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.299578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e11d2a5d-915b-4b60-8866-205c931aa98d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.299578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e11d2a5d-915b-4b60-8866-205c931aa98d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.299578] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e11d2a5d-915b-4b60-8866-205c931aa98d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.578284] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.801815] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.802646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.802967] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e11d2a5d-915b-4b60-8866-205c931aa98d with status ACTIVE [ 1016.805223] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.805223] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.805223] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.805223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.805223] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e11d2a5d-915b-4b60-8866-205c931aa98d is going to be updated. [ 1016.834610] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.834610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.834610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.834610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.834610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.834610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e11d2a5d-915b-4b60-8866-205c931aa98d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.005281] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: SUCCESS [ 1017.007889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.082477] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.082477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.082477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.082477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.082477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.082477] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1017.095154] env[66730]: INFO networking_nsxv3.common.synchronization [req-0e251172-9efb-4e6a-ac89-9e6d649ac37f req-8f705502-c38c-4846-a04d-3b725f844375 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 1017.095154] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 1017.095154] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.095154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.095154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.095154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.095154] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.095154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.095154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.098176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.098440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.098629] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.112117] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.114750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.114750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.114750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.114750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.133977] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1017.468903] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.469203] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.469361] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.469687] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.473541] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.473851] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.474131] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.474466] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.474712] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.475144] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.475347] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.475542] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.475740] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.476056] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.476270] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.476493] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.502797] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.502974] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1017.503354] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.503354] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.504234] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-6bcbfe8b-5071-4d63-b778-daae2b4ef814 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.504234] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-6bcbfe8b-5071-4d63-b778-daae2b4ef814" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.504234] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-6bcbfe8b-5071-4d63-b778-daae2b4ef814" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.505570] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-6bcbfe8b-5071-4d63-b778-daae2b4ef814" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.505570] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bcbfe8b-5071-4d63-b778-daae2b4ef814',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.601909] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.009769] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.009979] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.010071] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.010346] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.010506] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.010710] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 6bcbfe8b-5071-4d63-b778-daae2b4ef814 not found, creating... [ 1018.011308] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.011536] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.011674] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.011917] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.012082] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.012402] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.012559] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.012675] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.012895] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.013046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.014186] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 6bcbfe8b-5071-4d63-b778-daae2b4ef814 is going to be created. [ 1018.039813] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.041162] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.041162] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.041162] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.041162] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.042335] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-6bcbfe8b-5071-4d63-b778-daae2b4ef814" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.092072] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: SUCCESS [ 1018.092072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.092072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.092072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.092387] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.092387] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.092387] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.093045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.093045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.093045] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.107709] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.160810] env[66730]: INFO networking_nsxv3.common.synchronization [None req-f782d50b-cdd3-443e-9070-52ee2f4c1bc9 None None] Enqueued Resource ID: ac0a8649-0091-4eab-97fc-86e47b41fc2a with Priority: HIGHEST for action port [ 1018.161234] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0a8649-0091-4eab-97fc-86e47b41fc2a with Priority: HIGHEST for action port [ 1018.161553] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac0a8649-0091-4eab-97fc-86e47b41fc2a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.162116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac0a8649-0091-4eab-97fc-86e47b41fc2a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.162116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac0a8649-0091-4eab-97fc-86e47b41fc2a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.162116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac0a8649-0091-4eab-97fc-86e47b41fc2a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.162116] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac0a8649-0091-4eab-97fc-86e47b41fc2a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.595164] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.610076] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.610725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.610725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.610887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.610983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.611129] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 is going to be updated. [ 1018.653032] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.653032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.653032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.653032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.653032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.667558] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac0a8649-0091-4eab-97fc-86e47b41fc2a [ 1018.667558] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.667558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.667558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.667558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.667558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.667558] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac0a8649-0091-4eab-97fc-86e47b41fc2a already deleted. [ 1018.667558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac0a8649-0091-4eab-97fc-86e47b41fc2a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.667558] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: IN_PROGRESS for 2s [ 1018.790320] env[66730]: INFO networking_nsxv3.common.synchronization [req-0e251172-9efb-4e6a-ac89-9e6d649ac37f req-f634c449-7523-4ec7-b368-5385e139ded7 service nova] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_rules [ 1018.791114] env[66730]: INFO networking_nsxv3.common.synchronization [req-0e251172-9efb-4e6a-ac89-9e6d649ac37f req-f634c449-7523-4ec7-b368-5385e139ded7 service nova] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 1018.791114] env[66730]: INFO networking_nsxv3.common.synchronization [req-0e251172-9efb-4e6a-ac89-9e6d649ac37f req-f634c449-7523-4ec7-b368-5385e139ded7 service nova] Enqueued Resource ID: 6bcbfe8b-5071-4d63-b778-daae2b4ef814 with Priority: HIGHEST for action port [ 1018.793048] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_rules [ 1018.793048] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 1018.793048] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcbfe8b-5071-4d63-b778-daae2b4ef814 with Priority: HIGHEST for action port [ 1018.794052] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.794052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.794052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.795172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.795262] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.796611] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.796778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.797150] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bcbfe8b-5071-4d63-b778-daae2b4ef814 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.797306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bcbfe8b-5071-4d63-b778-daae2b4ef814" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.800019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bcbfe8b-5071-4d63-b778-daae2b4ef814" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.800019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bcbfe8b-5071-4d63-b778-daae2b4ef814" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.800019] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bcbfe8b-5071-4d63-b778-daae2b4ef814',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.099205] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.154393] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1019.154656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.155361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.155634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.155856] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.155998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.156105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.156300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.156396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.156493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.156605] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.299963] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.300707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.301041] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bcbfe8b-5071-4d63-b778-daae2b4ef814 with status ACTIVE [ 1019.301271] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.301396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.301475] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.301729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.301861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.302121] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.302251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.302314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.302508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.302587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.302786] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.302906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.302987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.306538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.306644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.306717] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bcbfe8b-5071-4d63-b778-daae2b4ef814 is going to be updated. [ 1019.335767] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.336036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.336211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.336469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.336697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.336981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bcbfe8b-5071-4d63-b778-daae2b4ef814" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.602270] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.602473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.602544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.602721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.602808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.602907] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae31dacc-8242-4331-8786-1526682530bd is going to be updated. [ 1019.643256] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.645917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.645917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.645917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.645917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.661692] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: IN_PROGRESS for 2s [ 1019.662209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.662418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.662577] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.662940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.663182] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.663354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.663417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.663548] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.663636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.663724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.663894] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.664216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.664216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.664509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.664786] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.664863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.664901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.668018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.668018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.668018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.668018] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.168422] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3e2980-ed0f-4c18-a149-cded1b258ec9: rpc.has_security_group_logging(os_id): False [ 1020.193933] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.194235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.194235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.194467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.218428] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.219066] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.219066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.219264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.219502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.219642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.220080] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.220250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.220393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.220640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.220758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.221085] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.221244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.221347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.221592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.221733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.221876] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1020.324111] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.324312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.324360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.324615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.324832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.340464] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1020.679277] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: SUCCESS [ 1020.679675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.680817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.680817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.680817] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.680817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.680817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.680817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.680817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.680817] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.718433] env[66730]: INFO networking_nsxv3.common.synchronization [req-b80ae291-fac2-42ce-9a91-4227631b7a99 req-3be95616-d755-4835-9522-9b9e0b5d8167 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_members [ 1020.720168] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad with Priority: HIGHEST for action security_group_members [ 1020.720168] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.720168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.720168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.720518] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.720518] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.720611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.720680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.720856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.720981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.721144] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78eaf9ae-5f5d-4844-9951-fbe27a99cdad',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.183612] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.224865] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.224865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.224865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.224865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.252977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.253296] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.253424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.253520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.253741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.253842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.253941] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad is going to be updated. [ 1021.297418] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.297596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.297741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.298054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.298260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.311606] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad in Status: IN_PROGRESS for 2s [ 1021.674853] env[66730]: INFO networking_nsxv3.common.synchronization [req-d7058b54-a49a-4b67-a0b0-241009db384d req-62a13ff0-9dd0-4cc6-a25d-e66818a87452 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1021.675893] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: SUCCESS [ 1021.676132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.679144] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1021.679314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.679644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.679723] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.679849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.679923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.680102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.680226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.680282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.680366] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.681667] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.681838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.681948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.682225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.682471] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.682603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.682672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.682889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.683069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.683251] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.685687] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.070776] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.071037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.071154] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.071431] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.071698] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.071883] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.072249] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.072374] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.072521] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.072731] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.072843] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.072952] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.073074] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.073179] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.073284] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.073417] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.098186] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.098487] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.098645] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.098826] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.099169] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-3a3e4b88-367d-4c8a-a0d0-237073994e70 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.099343] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-3a3e4b88-367d-4c8a-a0d0-237073994e70" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.099460] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-3a3e4b88-367d-4c8a-a0d0-237073994e70" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.099923] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-3a3e4b88-367d-4c8a-a0d0-237073994e70" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.100120] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a3e4b88-367d-4c8a-a0d0-237073994e70',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.185437] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.185668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.185718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.185961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.186153] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.186244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.186305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.186474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.186599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.186693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.186847] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.186971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.187073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.187232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.187402] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.187528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.187595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.187834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.187930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.188033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.188154] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.189331] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.189463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.189536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.189687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.189828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.190010] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.190115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.190175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.190316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.190405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.190520] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1022.191779] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.191889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.191939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.192136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.192203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.192292] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 is going to be updated. [ 1022.221057] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.221293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.221293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.221464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.221607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.223742] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.223926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.223926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.224103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.224227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.233949] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: IN_PROGRESS for 2s [ 1022.236368] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1022.363823] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1022.363978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.603992] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.603992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.603992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.603992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.603992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.604485] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 3a3e4b88-367d-4c8a-a0d0-237073994e70 not found, creating... [ 1022.604572] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.604736] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.604919] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.605251] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.605372] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.606131] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.606313] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.606435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.606734] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.606878] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.607036] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 3a3e4b88-367d-4c8a-a0d0-237073994e70 is going to be created. [ 1022.635510] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.635814] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.635975] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.636283] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.636520] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.636751] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-3a3e4b88-367d-4c8a-a0d0-237073994e70" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.694554] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae31dacc-8242-4331-8786-1526682530bd: rpc.has_security_group_logging(os_id): False [ 1022.715853] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.716111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.716111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.716434] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.746371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.746707] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.746834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.746898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.747197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.747300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.748054] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.748054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.748054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.748054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.748054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.749105] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.749105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.749105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.749105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.749105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.749105] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae31dacc-8242-4331-8786-1526682530bd is going to be updated. [ 1022.883726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.883726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.883726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.884234] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.884407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.920759] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: IN_PROGRESS for 2s [ 1023.334086] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad in Status: SUCCESS [ 1023.334336] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78eaf9ae-5f5d-4844-9951-fbe27a99cdad deletion is rescheduled due to dependency. [ 1023.334459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78eaf9ae-5f5d-4844-9951-fbe27a99cdad" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.411127] env[66730]: INFO networking_nsxv3.common.synchronization [req-d7058b54-a49a-4b67-a0b0-241009db384d req-d47b8bf0-2f2d-46fe-aea1-ea4f36b0baf4 service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 1023.411127] env[66730]: INFO networking_nsxv3.common.synchronization [req-d7058b54-a49a-4b67-a0b0-241009db384d req-d47b8bf0-2f2d-46fe-aea1-ea4f36b0baf4 service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1023.411127] env[66730]: INFO networking_nsxv3.common.synchronization [req-d7058b54-a49a-4b67-a0b0-241009db384d req-d47b8bf0-2f2d-46fe-aea1-ea4f36b0baf4 service nova] Enqueued Resource ID: 3a3e4b88-367d-4c8a-a0d0-237073994e70 with Priority: HIGHEST for action port [ 1023.411488] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 1023.411892] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1023.411892] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a3e4b88-367d-4c8a-a0d0-237073994e70 with Priority: HIGHEST for action port [ 1023.412091] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.412195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.412195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.412403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.412478] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.414075] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.414075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.414248] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a3e4b88-367d-4c8a-a0d0-237073994e70 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.414362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a3e4b88-367d-4c8a-a0d0-237073994e70" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.414428] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a3e4b88-367d-4c8a-a0d0-237073994e70" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.414612] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a3e4b88-367d-4c8a-a0d0-237073994e70" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.414694] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a3e4b88-367d-4c8a-a0d0-237073994e70',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.916845] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.917250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.917250] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a3e4b88-367d-4c8a-a0d0-237073994e70 with status ACTIVE [ 1023.917509] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.917653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.917735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.918034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.918124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.918344] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.918458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.918543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.918733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.918830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.919044] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.919204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.919275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.919452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.919544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.919643] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a3e4b88-367d-4c8a-a0d0-237073994e70 is going to be updated. [ 1023.944081] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.944081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.944081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.944081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.944081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.944423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a3e4b88-367d-4c8a-a0d0-237073994e70" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.246388] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1024.246662] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 1024.246720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.246894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.247134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.247320] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.247497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.249031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.249031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.249031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.249031] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.251528] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: SUCCESS [ 1024.251763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.251935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.252161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.252357] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.252502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.252538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.252686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.252768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.252854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.252942] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.757390] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.757390] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.940841] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: SUCCESS [ 1024.940841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.124416] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.124682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.124682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.124926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.125072] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.259664] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 086ea73c-820f-4794-8c0e-90c25aca8f44: rpc.has_security_group_logging(os_id): False [ 1025.260924] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.283348] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.283558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.283558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.283820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.283922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.284232] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.284368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.284453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.284645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.284749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.284852] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 is going to be updated. [ 1025.348838] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.349074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.349074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.349267] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.349408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.364904] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: IN_PROGRESS for 2s [ 1025.627156] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.764251] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.764505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.764505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.764630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.764728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.764882] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1025.795654] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.795902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.795902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.796274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.796469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.808286] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1026.129239] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.631312] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1026.631452] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1027.379584] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: SUCCESS [ 1027.380087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.586228] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.586479] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.586534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.586785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.601321] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1027.602169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.603232] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1027.638233] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.638419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.638495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.638768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.652912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.653659] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1027.653777] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1027.653883] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1027.698157] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.698384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.698384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.698586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.700422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.700707] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1027.785544] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.785866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.785866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.786210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.786586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.786926] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1027.818971] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1027.818971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.819204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.819295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.819566] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.819702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.819766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.819960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.820057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.820147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.820242] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.904100] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.904340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.904340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.904613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.904938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.905274] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1027.905374] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fb3e2980-ed0f-4c18-a149-cded1b258ec9', '4a600c3c-8d69-4e87-bbd9-ce6cd84e1121', 'b5a2ec48-323c-4685-a7de-26d245ffe466', '5330f620-bc9e-4469-a7f3-c664f754a6e9', '7a03f84a-bddc-4833-9f99-c1dc77481962', 'd435b8d7-20a4-46cb-ab34-d523daf07ab7', 'f152db72-4e1f-4942-b241-530ee83d9bd1', '398600ce-6668-4055-9c7c-d60ad413bf9d', 'c63f5ef2-5b7c-4817-aa38-f459fffee01a', '777ab4f0-3fef-4fad-954e-1a3565dcce4b', '1fdb3ab9-9d8a-4975-a734-c0f1297bd452', '086ea73c-820f-4794-8c0e-90c25aca8f44', '6a7c2214-9790-410b-aab0-021836529ff9', '4a4cf472-cf6e-4e66-bcb4-9cac485e9f91', 'ef7021c1-fc61-456d-b596-a046fb1931e7', '16d1896c-4d80-4a01-9c49-a61403e196c4', '74d582a7-b8c7-4980-ad04-779d4df3e481', '03d8cbe5-bd50-4c8a-8227-fc6effa07719', '4d3640ab-f13b-4406-87d7-65990dfad6d1', '0af4fa83-97d6-42c2-b25a-f1300fa319d8', 'd9136fc3-4b03-47d5-a4a4-e9dafaa7acb5', '6dd73e9d-f53e-4682-9229-6fa30e9d8043', 'a5161856-541b-4ad9-a7f2-629e78702077', '400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0', '395afc29-8cfd-45e2-9399-f1ce306e15d4', '6ca41c1b-622d-4ab6-868b-84dca5e38456', '9ef57016-b424-4876-b955-b7af3e07c7c4', '9d40e47e-8889-4be5-a560-287881831b93', '11fac9ba-96d2-4dbb-99c3-f32131a3e0dc', 'b4155358-3708-4cf2-b2a6-fe099ab35896', '94ea1b6a-f403-40f1-b3c2-7f52a8429c38', 'a42262f2-f569-4e53-9e7f-cce89b9f6ecb', '78eaf9ae-5f5d-4844-9951-fbe27a99cdad', '9ac62f82-b6ef-4c16-a3fd-c268cde0a17f', '90b73cdb-a74a-4eb6-9916-f76b4b7a65f9', 'a43e643f-8b52-4bbf-8dc6-b82fb3363343', 'ae31dacc-8242-4331-8786-1526682530bd', '0a55c2a9-6077-4f76-8e80-8d941329a6ba', 'cec4659b-96ff-48b6-ae37-82937d12179a', '7e4a2ee9-9ce1-46d2-900e-714dc4569d58', '11cfe5ac-91a4-4528-906d-a180bf81f5e5', '3990207f-c264-4f81-b18d-55d8c1cd003e', 'a144e600-f0ab-4527-b46f-661bc4067c25', 'a985d046-799d-4d0f-ae02-11071c04b015', 'fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0', '34c5c58e-4b22-4273-bd10-70b2a85bf96a'} {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1027.905466] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1027.928602] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.928845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.928845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.929127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.929237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.929363] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1027.929437] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1027.929511] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1028.043709] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.044080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.044080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.044253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.045284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.045557] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1028.045684] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1028.045684] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1028.045806] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1028.045872] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1028.045930] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGH for action security_group_rules [ 1028.045972] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGH for action security_group_rules [ 1028.046122] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5a2ec48-323c-4685-a7de-26d245ffe466 with Priority: HIGH for action security_group_rules [ 1028.046122] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGH for action security_group_rules [ 1028.046260] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGH for action security_group_rules [ 1028.046260] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGH for action security_group_rules [ 1028.046371] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGH for action security_group_rules [ 1028.046371] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGH for action security_group_rules [ 1028.046371] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGH for action security_group_rules [ 1028.046542] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGH for action security_group_rules [ 1028.046542] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGH for action security_group_rules [ 1028.046542] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGH for action security_group_rules [ 1028.046723] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGH for action security_group_rules [ 1028.046723] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGH for action security_group_rules [ 1028.046723] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGH for action security_group_rules [ 1028.046910] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGH for action security_group_rules [ 1028.046910] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGH for action security_group_rules [ 1028.046910] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 with Priority: HIGH for action security_group_rules [ 1028.046910] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGH for action security_group_rules [ 1028.047146] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGH for action security_group_rules [ 1028.047146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.323119] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.323358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.323411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.323663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.323862] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.323976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.324056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.324255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.324364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.324457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.324637] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.324738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.324799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.324968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.325149] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.325243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.325304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.325466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.325545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.325647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.325749] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.413086] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1028.413572] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 1028.413572] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGH for action security_group_rules [ 1028.413657] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a2ec48-323c-4685-a7de-26d245ffe466 with Priority: HIGH for action security_group_rules [ 1028.413764] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGH for action security_group_rules [ 1028.413957] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7021c1-fc61-456d-b596-a046fb1931e7 with Priority: HIGH for action security_group_rules [ 1028.414130] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGH for action security_group_rules [ 1028.414274] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 with Priority: HIGH for action security_group_rules [ 1028.415091] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 with Priority: HIGH for action security_group_rules [ 1028.415256] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGH for action security_group_rules [ 1028.415388] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 with Priority: HIGH for action security_group_rules [ 1028.415553] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 with Priority: HIGH for action security_group_rules [ 1028.415672] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGH for action security_group_rules [ 1028.415787] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGH for action security_group_rules [ 1028.415913] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGH for action security_group_rules [ 1028.416120] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b with Priority: HIGH for action security_group_rules [ 1028.416265] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a with Priority: HIGH for action security_group_rules [ 1028.416396] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGH for action security_group_rules [ 1028.416564] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398600ce-6668-4055-9c7c-d60ad413bf9d with Priority: HIGH for action security_group_rules [ 1028.416686] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 with Priority: HIGH for action security_group_rules [ 1028.416786] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 with Priority: HIGH for action security_group_rules [ 1028.416893] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGH for action security_group_rules [ 1028.417436] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.417650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.417707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.418064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.418179] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.419479] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5a2ec48-323c-4685-a7de-26d245ffe466 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.419634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.419706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.420030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.420131] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5a2ec48-323c-4685-a7de-26d245ffe466',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.421459] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.421593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.421593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.422470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.422470] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.423279] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef7021c1-fc61-456d-b596-a046fb1931e7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.423498] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.423641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.423754] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.423853] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef7021c1-fc61-456d-b596-a046fb1931e7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.425194] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.425332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.425430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.425691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.425838] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.426791] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d3640ab-f13b-4406-87d7-65990dfad6d1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.426940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.426991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.427244] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.427329] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d3640ab-f13b-4406-87d7-65990dfad6d1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.428464] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03d8cbe5-bd50-4c8a-8227-fc6effa07719 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.428617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.428686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.428887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.428993] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03d8cbe5-bd50-4c8a-8227-fc6effa07719',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.429868] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.430032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.430113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.430318] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.430417] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.431453] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.431587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.431659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.431847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.431981] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a4cf472-cf6e-4e66-bcb4-9cac485e9f91',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.432822] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16d1896c-4d80-4a01-9c49-a61403e196c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.433040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.433040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.433247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.433394] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16d1896c-4d80-4a01-9c49-a61403e196c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.434244] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.434381] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.434468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.434654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.434735] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.435823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.435991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.436078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.436267] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.436353] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.437335] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.437553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.437553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.437837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.437837] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.438746] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.438936] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.439032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.439182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.439267] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('777ab4f0-3fef-4fad-954e-1a3565dcce4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.440253] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.440388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.442053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.442225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.442379] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c63f5ef2-5b7c-4817-aa38-f459fffee01a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.444030] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.444030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.444030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.444030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.444030] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.444694] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398600ce-6668-4055-9c7c-d60ad413bf9d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.444848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.444919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.445166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.445291] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398600ce-6668-4055-9c7c-d60ad413bf9d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.446216] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a03f84a-bddc-4833-9f99-c1dc77481962 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.446314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.446395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.446573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.446658] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a03f84a-bddc-4833-9f99-c1dc77481962',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.447614] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.447757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.447898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.448162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.448271] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a600c3c-8d69-4e87-bbd9-ce6cd84e1121',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.449133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.449255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.828172] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5330f620-bc9e-4469-a7f3-c664f754a6e9: rpc.has_security_group_logging(os_id): False [ 1028.847445] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.847692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.847692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.847912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.869379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.869379] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.869379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.869379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.869379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.869379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.869379] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.869379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.869379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.869379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.869379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.869379] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.870095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.870095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.870095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.870095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.870095] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1028.963243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.963243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.963243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.963243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.963243] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.964302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.964302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.964302] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.964302] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1028.964302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.964302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.964914] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.964914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.964914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.964914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.964914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.964914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.964914] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.969852] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af4fa83-97d6-42c2-b25a-f1300fa319d8 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.969852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.969852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.969852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.969852] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.969852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.969852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.969852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.969852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.969852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.969852] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.969852] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.969852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.969852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.970489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.970489] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.970489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.970489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.970489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.971530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.971530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.971530] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.972730] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d435b8d7-20a4-46cb-ab34-d523daf07ab7 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.976127] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.976127] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.976127] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.976127] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.976127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.976972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.976972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.976972] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.977622] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.977622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.977622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.977815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.981230] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.981230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.981230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.981230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.981230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.981230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.981230] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.029385] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.029605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.029605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.029830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.045870] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.046097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.046950] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.047111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.048501] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.048624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.049349] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.049524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.050152] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.050269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.053496] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.053675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.056281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.056423] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 777ab4f0-3fef-4fad-954e-1a3565dcce4b is going to be deleted. [ 1029.058365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.058615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.061309] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.061489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.062355] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.062505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.063250] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.063366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.065101] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.065208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.084583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.084762] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5a2ec48-323c-4685-a7de-26d245ffe466 is going to be deleted. [ 1029.085728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.085965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.126236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.126416] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a600c3c-8d69-4e87-bbd9-ce6cd84e1121 is going to be deleted. [ 1029.127327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.127549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.153672] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.153932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.167057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.167057] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16d1896c-4d80-4a01-9c49-a61403e196c4 is going to be deleted. [ 1029.167949] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.168225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.171261] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.171494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.195674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.195906] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef7021c1-fc61-456d-b596-a046fb1931e7 is going to be deleted. [ 1029.197015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.197292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.199171] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.199385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.268623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.268816] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a03f84a-bddc-4833-9f99-c1dc77481962 is going to be deleted. [ 1029.269734] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.269984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.311140] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.311361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.313942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.314086] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a4cf472-cf6e-4e66-bcb4-9cac485e9f91 is going to be deleted. [ 1029.315008] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.315235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.333854] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.334189] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.345784] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.345977] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c63f5ef2-5b7c-4817-aa38-f459fffee01a is going to be deleted. [ 1029.346842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.347084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.391780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.391947] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03d8cbe5-bd50-4c8a-8227-fc6effa07719 is going to be deleted. [ 1029.392930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.393225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.407066] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.407284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.422857] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.423437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.424554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.424719] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d3640ab-f13b-4406-87d7-65990dfad6d1 is going to be deleted. [ 1029.425843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.425978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.458948] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.461860] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.463602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.463725] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398600ce-6668-4055-9c7c-d60ad413bf9d is going to be deleted. [ 1029.464664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.464880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.464966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.465134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-777ab4f0-3fef-4fad-954e-1a3565dcce4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.465491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.465671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.465758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.465887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5a2ec48-323c-4685-a7de-26d245ffe466" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.466466] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.466578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.466658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.466766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a600c3c-8d69-4e87-bbd9-ce6cd84e1121" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.467563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.467725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.467808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.467922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16d1896c-4d80-4a01-9c49-a61403e196c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.468081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.468231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.468319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.468438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef7021c1-fc61-456d-b596-a046fb1931e7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.469086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.469247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.469375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.469445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a03f84a-bddc-4833-9f99-c1dc77481962" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.469620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.469767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.469845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.469990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a4cf472-cf6e-4e66-bcb4-9cac485e9f91" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.484453] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.487188] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.487382] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.487430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.487655] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.487826] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.487952] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.488062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.488332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.488399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.488481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.488639] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.488736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.488801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.488944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.489102] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.489251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.489321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.489529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.489613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.489699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.489815] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.491063] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.491203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.491582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.491826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.492085] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.492256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.492365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.492597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.492731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.492875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.493152] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.493404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.493592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.493833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.494113] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.494254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.494325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.494477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.494558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.494645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.494740] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.500494] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.500680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.500752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.501174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.501174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.501366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c63f5ef2-5b7c-4817-aa38-f459fffee01a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.501620] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.502699] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.502818] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.502884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.503080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.503245] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.503339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.503399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.503544] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.503621] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.503732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.504647] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.504647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.504647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.504647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.504647] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.504647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.504647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.505261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.505261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.505261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.505261] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.506067] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.506176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.506236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.506374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.506606] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.507288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.507288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.507288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.507288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.507288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.507288] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.507591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.507591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.507591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.507687] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.508573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.508573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.508573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.508573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.508573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.508573] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.511268] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0af4fa83-97d6-42c2-b25a-f1300fa319d8: rpc.has_security_group_logging(os_id): False [ 1029.513274] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.513929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.513929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.513929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.513929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.513929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03d8cbe5-bd50-4c8a-8227-fc6effa07719" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.514754] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.514937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.515018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.515214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.515301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.515411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d3640ab-f13b-4406-87d7-65990dfad6d1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.540237] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.540538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.540538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.540810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.565102] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.565335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.566129] env[66730]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.566764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.567140] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.567313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.567379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.567650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.567740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.567937] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 is going to be updated. [ 1029.569147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.569358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.569464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.569602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398600ce-6668-4055-9c7c-d60ad413bf9d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.638322] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.638570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.638823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.639293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.639564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.666666] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 in Status: IN_PROGRESS for 2s [ 1029.961935] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 086ea73c-820f-4794-8c0e-90c25aca8f44: rpc.has_security_group_logging(os_id): False [ 1029.966805] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fdb3ab9-9d8a-4975-a734-c0f1297bd452: rpc.has_security_group_logging(os_id): False [ 1029.981518] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.981738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.981796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.982092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.986832] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d435b8d7-20a4-46cb-ab34-d523daf07ab7: rpc.has_security_group_logging(os_id): False [ 1029.988845] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.988996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.998915] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a7c2214-9790-410b-aab0-021836529ff9: rpc.has_security_group_logging(os_id): False [ 1030.000151] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74d582a7-b8c7-4980-ad04-779d4df3e481: rpc.has_security_group_logging(os_id): False [ 1030.009767] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.010037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.011278] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3e2980-ed0f-4c18-a149-cded1b258ec9: rpc.has_security_group_logging(os_id): False [ 1030.012385] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f152db72-4e1f-4942-b241-530ee83d9bd1: rpc.has_security_group_logging(os_id): False [ 1030.013953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.014243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.014361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.014418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.014625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.014727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.014830] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 is going to be updated. [ 1030.015851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.016046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.017628] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.017844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.019593] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.019797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.037014] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.037278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.038146] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.038281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.042924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.043283] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.043413] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.043478] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.043745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.043852] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.043973] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 is going to be updated. [ 1030.045496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.045624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.067567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.067902] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.068112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.068112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.068298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.068383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.068502] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 is going to be updated. [ 1030.069725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.069932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.099027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.099410] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.099556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.099556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.099767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.099850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.100101] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.100197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.100262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.100420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.100515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.100727] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.100795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.100863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.101016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.101098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.101190] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1030.102302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.102524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.104456] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.104601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.121298] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.121634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.137613] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.137895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.145457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.145767] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.145900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.145967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.146217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.146307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.146629] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.146756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.146817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.147059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.147172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.147298] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.147398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.147461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.147614] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.147685] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.147782] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 1030.149061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.149254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.184738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.184957] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.185096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.185158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.185363] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.185443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.185656] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.185755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.185807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.185954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.186038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.186217] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.186322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.186387] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.186548] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.186652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.186751] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1030.187992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.188174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.188313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.190063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.190259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.190481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.191523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.191708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.191905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.192842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.193021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.215021] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: IN_PROGRESS for 2s [ 1030.216293] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.216416] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.217100] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 in Status: IN_PROGRESS for 2s [ 1030.217723] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: IN_PROGRESS for 2s [ 1030.219930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.219983] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.220134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.220233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.220469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.220592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.220847] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.221016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.221108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.221299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.221398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.221635] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.221759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.221841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.222607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.222607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.222607] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 is going to be updated. [ 1030.223555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.223732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.224012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.260943] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.261300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.261388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.261635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.261909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.264075] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1030.280187] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 1030.349507] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.349757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.349757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.349933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.350148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.354098] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.354247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.354292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.354504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.354665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.382560] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: IN_PROGRESS for 2s [ 1030.383373] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1030.977494] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1030.978114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.978647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.978990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.979151] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.483051] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.485832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.485832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.485832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.485832] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.485832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.485832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.485832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.485832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.485832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.485832] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.684570] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 in Status: SUCCESS [ 1031.684570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.993650] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.994147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.994147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.994283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.994577] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.994577] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.994877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.994877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.994986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.995230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.995297] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.995480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.995565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.995747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.995948] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.996069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.996158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.996307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.996486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.996486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.996579] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.239831] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 in Status: SUCCESS [ 1032.240172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.244431] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: SUCCESS [ 1032.244771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.245808] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: SUCCESS [ 1032.246151] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.285188] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1032.285188] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.327076] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 1032.327451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.456041] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1032.456041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.456922] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: SUCCESS [ 1032.457197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.499286] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5330f620-bc9e-4469-a7f3-c664f754a6e9: rpc.has_security_group_logging(os_id): False [ 1032.527061] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.527061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.527061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.527431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.527522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.528269] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.529482] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.529876] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.531108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.532968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.532968] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.532968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.532968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.532968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.532968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.532968] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.532968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.532968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.532968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.532968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.533564] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1032.634630] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.634630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.634630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.634630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.634630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.651592] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1033.122373] env[66730]: INFO networking_nsxv3.common.synchronization [None req-8f61b020-ccab-4344-97f0-66f06bc1aa40 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 1033.122961] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 1033.123758] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.123971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.124122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.128500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.128769] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.128905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.128975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.129232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.129361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.129443] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.635767] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.636106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.636191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.636583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.661196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.662383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.662383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.662383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.662383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.662383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.662383] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 1033.693188] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.693407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.693407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.693714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.693890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.705704] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 1034.227091] env[66730]: INFO networking_nsxv3.common.synchronization [None req-19058cd3-551c-4eb0-93d4-1f3a62b9f5c8 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_rules [ 1034.228376] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_rules [ 1034.228376] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.228376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.228376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.228853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.228853] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.408600] env[66730]: INFO networking_nsxv3.common.synchronization [None req-08161661-df64-4a64-bc17-0fcc548f1b72 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_rules [ 1034.409532] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_rules [ 1034.411721] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.411721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.668227] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1034.668426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.752215] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.752404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.752452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.752665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.752808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.752868] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 already deleted. [ 1034.752908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.753144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.753243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.753325] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.280882] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.281367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.281367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.281454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.281529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.281720] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 already deleted. [ 1035.281859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.718199] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 1035.718505] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f deletion is rescheduled due to dependency. [ 1035.718649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.503755] env[66730]: INFO networking_nsxv3.common.synchronization [req-aedcf65a-adbb-46bd-9789-a88af15ad70e req-edb24ab1-fddb-4e13-bc71-0a276f64aafd tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1036.504312] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1036.504622] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.504805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.504805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.505020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.505174] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.505276] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.505340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.505478] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.505556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.505651] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.008260] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.515992] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.023343] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.023343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.023343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.023343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.023343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.023343] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1038.061519] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.062091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.062091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.062269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.062329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.075100] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1038.948986] env[66730]: INFO networking_nsxv3.common.synchronization [req-b2583774-a2d2-423c-a7c0-90b994a93d24 req-b8577ba9-80c6-46d2-9329-60f23fda6d0c tempest-ImagesTestJSON-681326034 tempest-ImagesTestJSON-681326034-project-member] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1038.949642] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1038.950401] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.950626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.950719] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.950935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.951175] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.951292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.951292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.951455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.951537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.951638] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.303755] env[66730]: INFO networking_nsxv3.common.synchronization [None req-6dfcfafd-964d-441d-b70e-68576073becb None None] Enqueued Resource ID: fc42fb00-1a85-4a4a-8b91-52cc62e78128 with Priority: HIGHEST for action port [ 1039.304345] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc42fb00-1a85-4a4a-8b91-52cc62e78128 with Priority: HIGHEST for action port [ 1039.305633] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc42fb00-1a85-4a4a-8b91-52cc62e78128 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.305633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc42fb00-1a85-4a4a-8b91-52cc62e78128" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.305633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc42fb00-1a85-4a4a-8b91-52cc62e78128" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.305633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc42fb00-1a85-4a4a-8b91-52cc62e78128" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.305633] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc42fb00-1a85-4a4a-8b91-52cc62e78128',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.454452] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.498835] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-777 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.499042] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.499194] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.499422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.499684] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.499992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.499992] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.500203] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.500338] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.500577] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.500698] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.500800] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.500907] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.501018] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.501369] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.501369] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.523019] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.523019] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1039.523019] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.523019] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.523019] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-bf7abb1c-18fd-488f-840c-9f5fded975fd taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.523325] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-bf7abb1c-18fd-488f-840c-9f5fded975fd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.523325] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-bf7abb1c-18fd-488f-840c-9f5fded975fd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.523552] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-bf7abb1c-18fd-488f-840c-9f5fded975fd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.523656] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf7abb1c-18fd-488f-840c-9f5fded975fd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.807465] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc42fb00-1a85-4a4a-8b91-52cc62e78128 [ 1039.807785] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.807953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.808078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.808346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.808451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.808547] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc42fb00-1a85-4a4a-8b91-52cc62e78128 already deleted. [ 1039.808635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc42fb00-1a85-4a4a-8b91-52cc62e78128" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.958476] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.027015] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.027287] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.027414] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.027699] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.027845] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.028016] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port bf7abb1c-18fd-488f-840c-9f5fded975fd not found, creating... [ 1040.028284] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.028441] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.028554] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.028771] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.028907] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.029613] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.029790] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.029913] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.030135] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.030276] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.030417] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: bf7abb1c-18fd-488f-840c-9f5fded975fd is going to be created. [ 1040.052390] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.052724] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.052857] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.053676] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.053950] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.054197] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-bf7abb1c-18fd-488f-840c-9f5fded975fd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.086687] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1040.086687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.461600] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.461802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.461846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.462071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.462162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.462262] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1040.494346] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.494571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.494647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.494828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.495022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.505975] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1040.819864] env[66730]: INFO networking_nsxv3.common.synchronization [req-b2583774-a2d2-423c-a7c0-90b994a93d24 req-e249197d-763c-41b2-ab1b-d4c5fe2689d2 service nova] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_rules [ 1040.820039] env[66730]: INFO networking_nsxv3.common.synchronization [req-b2583774-a2d2-423c-a7c0-90b994a93d24 req-e249197d-763c-41b2-ab1b-d4c5fe2689d2 service nova] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1040.820137] env[66730]: INFO networking_nsxv3.common.synchronization [req-b2583774-a2d2-423c-a7c0-90b994a93d24 req-e249197d-763c-41b2-ab1b-d4c5fe2689d2 service nova] Enqueued Resource ID: bf7abb1c-18fd-488f-840c-9f5fded975fd with Priority: HIGHEST for action port [ 1040.820730] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_rules [ 1040.820897] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1040.821924] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf7abb1c-18fd-488f-840c-9f5fded975fd with Priority: HIGHEST for action port [ 1040.822316] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.822420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.822512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.822739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.822830] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.824801] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.824923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.825145] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf7abb1c-18fd-488f-840c-9f5fded975fd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.825280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf7abb1c-18fd-488f-840c-9f5fded975fd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.825376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf7abb1c-18fd-488f-840c-9f5fded975fd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.825587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf7abb1c-18fd-488f-840c-9f5fded975fd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.825672] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf7abb1c-18fd-488f-840c-9f5fded975fd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.333713] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.333713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.334158] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf7abb1c-18fd-488f-840c-9f5fded975fd with status ACTIVE [ 1041.334158] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.334283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.334283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.334478] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.336008] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.336008] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.336008] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.336008] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.336225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.336225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.336812] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.336812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.336812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.336812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.336812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.337098] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf7abb1c-18fd-488f-840c-9f5fded975fd is going to be updated. [ 1041.364506] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.364506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.364506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.364506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.364506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.364506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf7abb1c-18fd-488f-840c-9f5fded975fd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.438255] env[66730]: INFO networking_nsxv3.common.synchronization [req-2a58fbb1-20fd-42d5-8e75-67942d322122 req-ae62c458-0976-45d1-ab13-c1561fa2ad72 tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 1041.438255] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 1041.438255] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.438255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.445674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.445674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.445674] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.445674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.445674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.445674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.445674] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.445674] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.858894] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.859355] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.859868] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.860356] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.861411] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.861411] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.861706] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.862200] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.862852] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.862852] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.863210] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.863502] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.864347] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.864619] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.864855] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.865146] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.891168] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.891610] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.891765] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.891947] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.892565] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-99b31bdb-269b-4f17-b568-7222d523626b taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.893507] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.893630] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.894330] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.894522] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99b31bdb-269b-4f17-b568-7222d523626b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.947203] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.947423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.947634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.948018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.971133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.971505] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.971661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.971726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.971964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.972087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.972209] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 is going to be updated. [ 1042.002563] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.002803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.002902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.003196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.003354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.013508] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: IN_PROGRESS for 2s [ 1042.024733] env[66730]: INFO networking_nsxv3.common.synchronization [None req-6c4d918c-5c7e-4e8b-94ef-ab8df244bdba None None] Enqueued Resource ID: 23afb222-cd40-42c0-86c0-216e5237fddf with Priority: HIGHEST for action port [ 1042.024733] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23afb222-cd40-42c0-86c0-216e5237fddf with Priority: HIGHEST for action port [ 1042.024733] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-23afb222-cd40-42c0-86c0-216e5237fddf taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.025163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23afb222-cd40-42c0-86c0-216e5237fddf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.025346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23afb222-cd40-42c0-86c0-216e5237fddf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.025724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23afb222-cd40-42c0-86c0-216e5237fddf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.025923] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23afb222-cd40-42c0-86c0-216e5237fddf',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.399916] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.399916] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.399916] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.399916] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.399916] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.399916] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 99b31bdb-269b-4f17-b568-7222d523626b not found, creating... [ 1042.399916] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.399916] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.400633] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.400633] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.400633] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.400780] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.400954] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.401082] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.401304] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.401436] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.401573] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 99b31bdb-269b-4f17-b568-7222d523626b is going to be created. [ 1042.422919] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.423228] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.423395] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.423700] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.423929] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.424163] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.517992] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1042.518443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.518649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.518903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.519149] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.519269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.519353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.519543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.519635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.519736] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.528639] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23afb222-cd40-42c0-86c0-216e5237fddf [ 1042.529136] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.529353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.529564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.529908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.530073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.530306] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23afb222-cd40-42c0-86c0-216e5237fddf already deleted. [ 1042.530378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23afb222-cd40-42c0-86c0-216e5237fddf" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.575982] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.576365] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.576463] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.576695] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.577024] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.577234] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.577367] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.577615] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.577778] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.577988] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.578161] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.578334] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.578559] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.578709] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.578836] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.578983] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.605290] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.605290] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.605290] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.605290] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.605569] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-31b4afae-052b-4d3a-b6d7-255edffc0ba3 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.605977] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.606490] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.606933] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.607127] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b4afae-052b-4d3a-b6d7-255edffc0ba3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.023404] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.110560] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.110805] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.110925] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.111254] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.111419] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.111583] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 31b4afae-052b-4d3a-b6d7-255edffc0ba3 not found, creating... [ 1043.111878] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.112073] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.112196] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.112421] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.112587] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.112886] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.113051] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.113169] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.113377] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.113512] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.113649] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 31b4afae-052b-4d3a-b6d7-255edffc0ba3 is going to be created. [ 1043.139052] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.139052] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.139052] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.139052] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.139052] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.139052] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.174515] env[66730]: INFO networking_nsxv3.common.synchronization [req-2a58fbb1-20fd-42d5-8e75-67942d322122 req-f79478ed-1f45-444d-ba5e-a7e2ad19753d service nova] Enqueued Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_rules [ 1043.174588] env[66730]: INFO networking_nsxv3.common.synchronization [req-2a58fbb1-20fd-42d5-8e75-67942d322122 req-f79478ed-1f45-444d-ba5e-a7e2ad19753d service nova] Enqueued Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 1043.174698] env[66730]: INFO networking_nsxv3.common.synchronization [req-2a58fbb1-20fd-42d5-8e75-67942d322122 req-f79478ed-1f45-444d-ba5e-a7e2ad19753d service nova] Enqueued Resource ID: 99b31bdb-269b-4f17-b568-7222d523626b with Priority: HIGHEST for action port [ 1043.174908] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_rules [ 1043.175049] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 1043.175148] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b31bdb-269b-4f17-b568-7222d523626b with Priority: HIGHEST for action port [ 1043.175677] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.176245] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.176329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.176533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.176621] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.178668] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.178668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.178668] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-99b31bdb-269b-4f17-b568-7222d523626b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.178668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.178668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.178668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.178668] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99b31bdb-269b-4f17-b568-7222d523626b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.322030] env[66730]: INFO networking_nsxv3.common.synchronization [None req-c15770bb-8f5f-476c-a85f-a7d39280ac63 tempest-ServersTestBootFromVolume-1355893261 tempest-ServersTestBootFromVolume-1355893261-project-member] Enqueued Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_rules [ 1043.322564] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_rules [ 1043.322788] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0031949-c54e-4110-961e-a682a87e628f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.322843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.322912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.323346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.323502] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.527918] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.556394] env[66730]: INFO networking_nsxv3.common.synchronization [None req-776af0b7-68d5-4cda-b2db-ce2d7528882f tempest-ServersTestBootFromVolume-1355893261 tempest-ServersTestBootFromVolume-1355893261-project-member] Enqueued Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_rules [ 1043.556948] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_rules [ 1043.557513] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0031949-c54e-4110-961e-a682a87e628f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.557513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.680090] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.680241] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.680512] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99b31bdb-269b-4f17-b568-7222d523626b with status ACTIVE [ 1043.680747] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.680861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.681010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.681147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.681260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.681469] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.681550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.682122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.682373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.682463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.682651] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.682750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.682851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.683054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.683149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.683236] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99b31bdb-269b-4f17-b568-7222d523626b is going to be updated. [ 1043.713500] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.713500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.713500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.713500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.713500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.713500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.850707] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.850845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.852996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.852996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.852996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.852996] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0031949-c54e-4110-961e-a682a87e628f already deleted. [ 1043.852996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.852996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.852996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.852996] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.900762] env[66730]: INFO networking_nsxv3.common.synchronization [req-e4d3a950-73b2-4781-a46b-6881606d658a req-6f2bc731-9db3-477d-aeb3-93a97ffe9355 service nova] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_rules [ 1043.901091] env[66730]: INFO networking_nsxv3.common.synchronization [req-e4d3a950-73b2-4781-a46b-6881606d658a req-6f2bc731-9db3-477d-aeb3-93a97ffe9355 service nova] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 1043.901324] env[66730]: INFO networking_nsxv3.common.synchronization [req-e4d3a950-73b2-4781-a46b-6881606d658a req-6f2bc731-9db3-477d-aeb3-93a97ffe9355 service nova] Enqueued Resource ID: 31b4afae-052b-4d3a-b6d7-255edffc0ba3 with Priority: HIGHEST for action port [ 1043.902413] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_rules [ 1043.902643] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 1043.902814] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b4afae-052b-4d3a-b6d7-255edffc0ba3 with Priority: HIGHEST for action port [ 1043.903251] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.903443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.903540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.903961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.903961] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.906616] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.906908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.907091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.907390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.907658] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.909138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.909138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.909138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.911768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.911998] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.913900] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-31b4afae-052b-4d3a-b6d7-255edffc0ba3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.914129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.914194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.915748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.915748] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b4afae-052b-4d3a-b6d7-255edffc0ba3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.026210] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: SUCCESS [ 1044.026432] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 deletion is rescheduled due to dependency. [ 1044.026945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.026945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.026945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.027070] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.027178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.027240] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.027414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.027497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.027705] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.030568] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.030741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.030833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.032991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.032991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.032991] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1044.078407] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.078550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.078619] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.078925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.079035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.090158] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1044.375921] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.375921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.375921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.375921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.375921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.375921] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0031949-c54e-4110-961e-a682a87e628f already deleted. [ 1044.377694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.418772] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.418772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.418772] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.420153] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31b4afae-052b-4d3a-b6d7-255edffc0ba3 with status ACTIVE [ 1044.420336] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.421470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.421470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.421470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.424011] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.426929] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.426929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.426929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.426929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.426929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.426929] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.427877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.427951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.428202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.428463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.428607] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31b4afae-052b-4d3a-b6d7-255edffc0ba3 is going to be updated. [ 1044.456831] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.457013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.457104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.457329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.457531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.457727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.531048] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.931230] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.032599] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.433252] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.433375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.433454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.434383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.434383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.434383] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 1045.469145] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.469145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.469145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.469145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.469145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.479961] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 1045.535265] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.535796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.535894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.536166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.536281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.536506] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 is going to be updated. [ 1045.568662] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.568813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.568883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.569239] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.569450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.578391] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: IN_PROGRESS for 2s [ 1046.044157] env[66730]: INFO networking_nsxv3.common.synchronization [req-9164f0c7-949e-4262-bc3b-85cacf255d7f req-aba95fdc-4329-417f-aad7-2aa85c4e2386 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_members [ 1046.044157] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_members [ 1046.044157] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.044157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.044157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.045333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.045648] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.046356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.046559] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.046856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.047141] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.047620] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.103021] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1046.103021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.103021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.103021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.103021] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.103021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.103021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.103021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.103021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.103021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.103021] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.554293] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.554293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.554293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.554293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.554293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.554293] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.554293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.554293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.554293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.554293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.554293] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 already deleted. [ 1046.554293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.607562] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.607562] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.607562] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.607562] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.607562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.608397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.608397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.608397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.608397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.608397] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.084192] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.084390] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.084523] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.084874] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.085178] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.085344] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.085463] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.085683] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.085822] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.086032] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.086144] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.086249] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.086353] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.086463] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.086563] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.086689] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.106954] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.107135] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1047.107267] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.107435] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-791" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.107778] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-3d5ac6e1-7212-46f9-b983-3494fce4ff03 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.107922] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-3d5ac6e1-7212-46f9-b983-3494fce4ff03" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.108046] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-3d5ac6e1-7212-46f9-b983-3494fce4ff03" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.108422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-3d5ac6e1-7212-46f9-b983-3494fce4ff03" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.108571] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d5ac6e1-7212-46f9-b983-3494fce4ff03',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.109448] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a7c2214-9790-410b-aab0-021836529ff9: rpc.has_security_group_logging(os_id): False [ 1047.128456] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.128692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.128692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.128854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.128937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.129149] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.129253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.129373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.129462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.129620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.129712] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.129802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.129862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.130010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.130084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.130311] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.130421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.130471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.130600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.130662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.130754] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1047.197432] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.197639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.197639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.197845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.198125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.217257] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1047.493338] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 1047.493642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.493858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.494137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.494406] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.494628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.494727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.494930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.495073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.495216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.495370] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.588035] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: SUCCESS [ 1047.588392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.588487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.588775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.588998] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.589156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.589228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.589542] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.589679] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.589800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.589907] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.611727] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.611941] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.612083] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.612380] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.612527] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.612680] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 3d5ac6e1-7212-46f9-b983-3494fce4ff03 not found, creating... [ 1047.613155] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.613335] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.613449] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.613672] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.613807] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.614107] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.614257] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.614369] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.614580] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.614976] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.614976] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 3d5ac6e1-7212-46f9-b983-3494fce4ff03 is going to be created. [ 1047.638810] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.639101] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.639232] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.639520] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.639748] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.639995] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-3d5ac6e1-7212-46f9-b983-3494fce4ff03" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.999274] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.999690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.999898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.000390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.000782] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.001100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.001333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.001728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.001956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.002211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.002608] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.002872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.003062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.003384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.003665] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.003849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.004024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.004465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.004640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.005103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.005103] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.092411] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.092692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.092692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.093143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.093446] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.093622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.093622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.094607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.094607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.094607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.094607] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.094607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.095820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.095820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.095820] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.095820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.095820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.095820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.095820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.095820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.096214] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.433274] env[66730]: INFO networking_nsxv3.common.synchronization [req-9164f0c7-949e-4262-bc3b-85cacf255d7f req-a87d993d-b762-4de0-915b-30ad2a30a5f0 service nova] Enqueued Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_rules [ 1048.433274] env[66730]: INFO networking_nsxv3.common.synchronization [req-9164f0c7-949e-4262-bc3b-85cacf255d7f req-a87d993d-b762-4de0-915b-30ad2a30a5f0 service nova] Enqueued Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_members [ 1048.433274] env[66730]: INFO networking_nsxv3.common.synchronization [req-9164f0c7-949e-4262-bc3b-85cacf255d7f req-a87d993d-b762-4de0-915b-30ad2a30a5f0 service nova] Enqueued Resource ID: 3d5ac6e1-7212-46f9-b983-3494fce4ff03 with Priority: HIGHEST for action port [ 1048.434800] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_rules [ 1048.435414] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_members [ 1048.435927] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d5ac6e1-7212-46f9-b983-3494fce4ff03 with Priority: HIGHEST for action port [ 1048.438629] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.438629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.438629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.438629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.438629] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.439692] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.439995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.440201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.440561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.440850] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.441279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.441814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.442136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.442465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.442678] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.448080] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d5ac6e1-7212-46f9-b983-3494fce4ff03 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.448302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d5ac6e1-7212-46f9-b983-3494fce4ff03" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.448302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d5ac6e1-7212-46f9-b983-3494fce4ff03" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.448847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d5ac6e1-7212-46f9-b983-3494fce4ff03" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.448847] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d5ac6e1-7212-46f9-b983-3494fce4ff03',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.508149] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f: rpc.has_security_group_logging(os_id): False [ 1048.540577] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.543024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.543024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.543024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.543024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.543024] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.543024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.543024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.543024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.543691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.544097] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.544371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.544603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.544916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.545206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.545577] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.545869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.546076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.546377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.548262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.548262] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 1048.603035] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ef57016-b424-4876-b955-b7af3e07c7c4: rpc.has_security_group_logging(os_id): False [ 1048.622276] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.622492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.622584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.622807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.622918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.623183] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.623293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.623437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.623628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.623707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.623912] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.624016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.624088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.624257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.624376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.624575] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.624990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.624990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.625149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.625193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.625269] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 is going to be updated. [ 1048.629580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.629697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.629764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.629944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.630117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.646346] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 1048.699911] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.700130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.700239] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.700565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.700879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.714268] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: IN_PROGRESS for 2s [ 1048.941830] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.941830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.953075] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d5ac6e1-7212-46f9-b983-3494fce4ff03 with status ACTIVE [ 1048.953075] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.953075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.953075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.953075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.953497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.953799] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.954118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.954330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.954595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.954696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.955336] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.955485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.955556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.955792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.955870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.955969] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d5ac6e1-7212-46f9-b983-3494fce4ff03 is going to be updated. [ 1048.958270] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.989040] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.989266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.989316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.989593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.989761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.990050] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d5ac6e1-7212-46f9-b983-3494fce4ff03" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.244500] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1049.245336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.462228] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.965567] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.965567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.965567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.965567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.965567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.965567] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 is going to be created. [ 1050.002023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.002023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.002023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.002764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.002891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.015468] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 in Status: UNINITIALIZED for 2s [ 1050.665249] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 1050.665249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.729391] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: SUCCESS [ 1050.729632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.445105] env[66730]: INFO networking_nsxv3.common.synchronization [req-c026675e-6429-4748-9bb7-39f1514432bb req-98509919-b174-457d-9507-ecd2eaa08510 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1051.445393] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1051.445759] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.445879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.445955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.446163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.446373] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.446451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.446451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.446897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.446897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.446897] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.949149] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.949443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.949443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.949742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.949802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.949948] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.950054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.950108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.950261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.950333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.950444] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1051.992864] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.992864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.992864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.993748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.993748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.009097] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1052.029343] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 in Status: SUCCESS [ 1052.029343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.029343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.029692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.029692] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.029788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.029788] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.030132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.030263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.030417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.030526] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.532736] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.035292] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6: rpc.has_security_group_logging(os_id): False [ 1053.055259] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.055599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.055707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.055993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.056159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.056547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.056710] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.056821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.057100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.057243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.057399] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 is going to be created. [ 1053.135958] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.135958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.135958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.135958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.136315] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.149551] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 in Status: IN_PROGRESS for 2s [ 1053.818458] env[66730]: INFO networking_nsxv3.common.synchronization [req-4a74f0fd-9a40-403f-9b5b-2f6c1f7ee455 req-73b8a94e-d50b-4297-8050-70141b7acbf0 tempest-ServerActionsV293TestJSON-1968079804 tempest-ServerActionsV293TestJSON-1968079804-project-member] Enqueued Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_members [ 1053.820657] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGHEST for action security_group_members [ 1053.820657] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d435b8d7-20a4-46cb-ab34-d523daf07ab7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.820657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.820657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.820657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.820657] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.821207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.821207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.821207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.821207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.821580] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.886831] env[66730]: INFO networking_nsxv3.common.synchronization [req-30823bff-5cf8-45d5-b43c-b6038d2cb7af req-b0471315-3a9f-434d-83b8-9f20e7ec926a tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 1053.887547] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 with Priority: HIGHEST for action security_group_members [ 1053.887882] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ef57016-b424-4876-b955-b7af3e07c7c4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.888086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.888086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.889834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.889834] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.889834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.889834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.889834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.889834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.889834] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ef57016-b424-4876-b955-b7af3e07c7c4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.974066] env[66730]: INFO networking_nsxv3.common.synchronization [req-30823bff-5cf8-45d5-b43c-b6038d2cb7af req-b0471315-3a9f-434d-83b8-9f20e7ec926a tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 99b31bdb-269b-4f17-b568-7222d523626b with Priority: HIGHEST for action port [ 1053.974648] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b31bdb-269b-4f17-b568-7222d523626b with Priority: HIGHEST for action port [ 1053.974969] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-99b31bdb-269b-4f17-b568-7222d523626b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.975129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.975253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.975859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.975859] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99b31bdb-269b-4f17-b568-7222d523626b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.020438] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1054.020703] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 1054.020812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.325045] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.325045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.325045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.325423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.325423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.325492] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.326374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.326374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.326374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.326374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.326374] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 is going to be updated. [ 1054.361382] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.361552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.361596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.361901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.361992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.373473] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 in Status: IN_PROGRESS for 2s [ 1054.394465] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.394465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.394465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.394465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.394465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.394465] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.394465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.394465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.394465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.394465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.394465] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 is going to be updated. [ 1054.427052] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.427178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.427260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.427480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.427677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.439078] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: IN_PROGRESS for 2s [ 1054.481023] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99b31bdb-269b-4f17-b568-7222d523626b with status ACTIVE [ 1054.481023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.481023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.481023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.481316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.481356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.482083] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.482083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.482083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.482083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.482083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.482344] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.482344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.482344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.482569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.482569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.482643] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99b31bdb-269b-4f17-b568-7222d523626b is going to be updated. [ 1054.508209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.508846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.508966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.509207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.509384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.509593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99b31bdb-269b-4f17-b568-7222d523626b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.739103] env[66730]: INFO networking_nsxv3.common.synchronization [req-9ba88ace-052c-4fa8-a651-b345305fb757 req-0fafe896-1287-4789-b053-8c78b4593ecc tempest-ServerRescueTestJSON-513474333 tempest-ServerRescueTestJSON-513474333-project-member] Enqueued Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 1054.739751] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 1054.740081] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.740248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.740304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.740572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.740632] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.740717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.740791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.740940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.741032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.741127] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.165764] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 in Status: SUCCESS [ 1055.165764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.245963] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.750502] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.256839] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.257253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.257253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.257465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.257623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.258411] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae31dacc-8242-4331-8786-1526682530bd is going to be updated. [ 1056.301404] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.301404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.301404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.301689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.301689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.314192] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: IN_PROGRESS for 2s [ 1056.385927] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 in Status: SUCCESS [ 1056.386127] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 deletion is rescheduled due to dependency. [ 1056.386289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.453744] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 in Status: SUCCESS [ 1056.453744] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ef57016-b424-4876-b955-b7af3e07c7c4 deletion is rescheduled due to dependency. [ 1056.455062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ef57016-b424-4876-b955-b7af3e07c7c4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.325799] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: SUCCESS [ 1058.326090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.745440] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1059.745929] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1060.561802] env[66730]: INFO networking_nsxv3.common.synchronization [req-e594a01d-bffb-4993-92a3-0934613b32e3 req-1de9d41f-b907-4e75-9091-a550b7f913fe tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1060.562332] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1060.562660] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.562820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.562892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.565922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.566148] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.566262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.566329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.566507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.566620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.566724] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.894666] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-223 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.894666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.894666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.895185] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.895227] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.895392] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.895507] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.895737] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.895880] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.896141] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.896277] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.896387] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.896493] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.896613] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.896719] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.896870] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.925400] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.926374] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1060.926374] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.926374] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.926563] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-0865cc23-c6ca-4628-93d2-51104847c631 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.926676] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-0865cc23-c6ca-4628-93d2-51104847c631" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.926811] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-0865cc23-c6ca-4628-93d2-51104847c631" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.928036] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-0865cc23-c6ca-4628-93d2-51104847c631" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.928036] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0865cc23-c6ca-4628-93d2-51104847c631',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.070788] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.429708] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.429943] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.430110] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.430379] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.430519] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.430782] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 0865cc23-c6ca-4628-93d2-51104847c631 not found, creating... [ 1061.431096] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.431280] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.431400] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.431843] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.432283] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.432669] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.432861] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.432986] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.433353] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.433415] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.433526] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 0865cc23-c6ca-4628-93d2-51104847c631 is going to be created. [ 1061.460072] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.460072] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.460072] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.460072] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.460394] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.460394] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-0865cc23-c6ca-4628-93d2-51104847c631" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.573326] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.006990] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.007335] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.007335] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.007610] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.007868] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.008089] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.008171] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.008404] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.008554] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.008770] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.008883] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.008989] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.009105] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.009213] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.009315] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.009443] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.028401] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.028594] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.028692] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.028870] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-502" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.029249] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-31b4afae-052b-4d3a-b6d7-255edffc0ba3 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.029441] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.029560] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.029856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.029993] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b4afae-052b-4d3a-b6d7-255edffc0ba3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.077677] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.077884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.077884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.078115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.078212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.078298] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1062.106168] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.106398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.106398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.106600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.106744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.116741] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1062.146374] env[66730]: INFO networking_nsxv3.common.synchronization [req-e594a01d-bffb-4993-92a3-0934613b32e3 req-7fe9fbdd-3bdd-42f6-a4fd-c2f864e20763 service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1062.146600] env[66730]: INFO networking_nsxv3.common.synchronization [req-e594a01d-bffb-4993-92a3-0934613b32e3 req-7fe9fbdd-3bdd-42f6-a4fd-c2f864e20763 service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1062.146740] env[66730]: INFO networking_nsxv3.common.synchronization [req-e594a01d-bffb-4993-92a3-0934613b32e3 req-7fe9fbdd-3bdd-42f6-a4fd-c2f864e20763 service nova] Enqueued Resource ID: 0865cc23-c6ca-4628-93d2-51104847c631 with Priority: HIGHEST for action port [ 1062.147285] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1062.147438] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1062.147601] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0865cc23-c6ca-4628-93d2-51104847c631 with Priority: HIGHEST for action port [ 1062.147999] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.148181] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.148255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.148461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.148546] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.149916] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.150044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.150238] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-0865cc23-c6ca-4628-93d2-51104847c631 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.150448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0865cc23-c6ca-4628-93d2-51104847c631" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.150448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0865cc23-c6ca-4628-93d2-51104847c631" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.150680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0865cc23-c6ca-4628-93d2-51104847c631" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.150680] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0865cc23-c6ca-4628-93d2-51104847c631',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.458055] env[66730]: INFO networking_nsxv3.common.synchronization [req-b117c4b4-8fb6-48f4-9f29-500d95332efb req-9fb0482c-bf16-4386-ad54-e77ea2ff72b9 tempest-ImagesTestJSON-681326034 tempest-ImagesTestJSON-681326034-project-member] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1062.458675] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1062.458987] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.459153] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.459224] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.459410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.459578] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.459670] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.459740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.459886] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.459963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.460075] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.532873] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.533347] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.533700] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.534126] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.534333] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.534682] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.534986] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.535160] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.535481] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.535639] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.536151] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.536286] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.536762] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.536762] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.536762] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.537041] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 31b4afae-052b-4d3a-b6d7-255edffc0ba3 is going to be updated. [ 1062.559706] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.559855] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.559980] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.560290] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.560538] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.560817] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.652302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.652627] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.653072] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0865cc23-c6ca-4628-93d2-51104847c631 with status ACTIVE [ 1062.653275] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.653474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.653474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.653678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.653762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.653983] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.654176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.654176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.654418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.654502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.654748] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.654880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.654938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.655101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.655193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.655263] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0865cc23-c6ca-4628-93d2-51104847c631 is going to be updated. [ 1062.690499] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.690499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.690787] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.690869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.690990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.691178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0865cc23-c6ca-4628-93d2-51104847c631" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.964218] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.277320] env[66730]: INFO networking_nsxv3.common.synchronization [req-b77e8949-2130-4328-b5e6-87460e67e632 req-08c00b35-efc3-4668-a594-ea7722d9c477 service nova] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_rules [ 1063.277593] env[66730]: INFO networking_nsxv3.common.synchronization [req-b77e8949-2130-4328-b5e6-87460e67e632 req-08c00b35-efc3-4668-a594-ea7722d9c477 service nova] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 1063.277636] env[66730]: INFO networking_nsxv3.common.synchronization [req-b77e8949-2130-4328-b5e6-87460e67e632 req-08c00b35-efc3-4668-a594-ea7722d9c477 service nova] Enqueued Resource ID: 31b4afae-052b-4d3a-b6d7-255edffc0ba3 with Priority: HIGHEST for action port [ 1063.278500] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_rules [ 1063.278701] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 1063.278795] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b4afae-052b-4d3a-b6d7-255edffc0ba3 with Priority: HIGHEST for action port [ 1063.279084] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.279228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.279271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.279465] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.279637] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.284207] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.284207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.284207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.284207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.284207] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.284207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.284207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.284207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.284207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.284207] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.284626] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-31b4afae-052b-4d3a-b6d7-255edffc0ba3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.288927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.288927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.288927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.288927] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b4afae-052b-4d3a-b6d7-255edffc0ba3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.466286] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.782309] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.782515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.791100] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31b4afae-052b-4d3a-b6d7-255edffc0ba3 with status ACTIVE [ 1063.791100] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.791100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.791100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.791100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.791100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.791100] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.791100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.791100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.791100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.791100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.791100] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.791100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.791624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.791624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.791624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.791624] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31b4afae-052b-4d3a-b6d7-255edffc0ba3 is going to be updated. [ 1063.793022] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.873846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.873846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.873846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.874986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.875732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.876210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31b4afae-052b-4d3a-b6d7-255edffc0ba3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.969148] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.969325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.969397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.969621] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.969713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.969814] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1064.104722] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.104945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.104945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.105155] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.105307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.130128] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1064.140328] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1064.141148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.141148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.141434] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.141513] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.141680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.141774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.142361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.142361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.142485] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.296404] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.412793] env[66730]: INFO networking_nsxv3.common.synchronization [req-270b923c-4a6c-453f-b208-dcf4a38f37cc req-88970aeb-cea3-4df3-99a8-ad6de05a542e tempest-AttachVolumeShelveTestJSON-1677719075 tempest-AttachVolumeShelveTestJSON-1677719075-project-member] Enqueued Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_members [ 1064.413852] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGHEST for action security_group_members [ 1064.413852] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.414206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.414206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.414289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.416523] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.416523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.416523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.416523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.416523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.416523] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.645485] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.803023] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.803023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.803023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.803023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.803023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.803023] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 1064.830881] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.831158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.831158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.831288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.831427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.840675] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 1064.918315] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.918471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.918552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.918890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.918932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.919156] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.919270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.919347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.919869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.919869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.919869] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 is going to be updated. [ 1064.948210] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.948367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.948442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.948684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.949308] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.958429] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: IN_PROGRESS for 2s [ 1065.148010] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.650977] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.651330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.651330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.651487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.651565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.651712] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1065.683483] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.683654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.683751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.683992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.684205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.694531] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1066.143650] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1066.143965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.850065] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 1066.850441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.850441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.850680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.850859] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.850984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.851084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.851223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.851302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.851383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.851476] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.968033] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 in Status: SUCCESS [ 1066.968235] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 deletion is rescheduled due to dependency. [ 1066.968347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.354525] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.354695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.354766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.355077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.355254] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.355365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.355427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.355574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.355660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.355752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.355899] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.355990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.356058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.356201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.356339] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.356429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.356487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.356622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.356697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.356782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.356869] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.706628] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1067.706842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.707032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.707313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.707541] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.707678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.707746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.707910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.707992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.708092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.708182] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.859635] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f: rpc.has_security_group_logging(os_id): False [ 1067.878556] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.878815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.878815] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.878994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.879149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.879415] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.879551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.879640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.879865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.879978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.880226] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.880339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.880436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.880639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.880756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.880948] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.881058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.881120] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.881532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.881532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.881532] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 1068.109745] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.109985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.110062] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.110341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.110749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.137466] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 1068.210394] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.210651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.210773] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.211193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.211479] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.211679] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.211897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.212229] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.212365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.212499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.212756] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.212902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.212993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.213558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.213785] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.213952] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.214077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.214331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.214462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.214586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.214733] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.720526] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3e2980-ed0f-4c18-a149-cded1b258ec9: rpc.has_security_group_logging(os_id): False [ 1068.739159] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.739382] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.739463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.739687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.739954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.740220] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.740360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.740414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.740578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.740677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.740954] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.741075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.741127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.741328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.741426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.741621] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.741741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.741800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.741913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.741986] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.742089] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1068.807085] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.807279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.807397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.807631] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.807801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.824950] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1069.221558] env[66730]: INFO networking_nsxv3.common.synchronization [req-ef6d401f-ac88-4776-b205-77d0a9ff4d6a req-7a35bc9b-e21c-4d00-bedf-f1e6800d4d1b tempest-ServerRescueTestJSON-513474333 tempest-ServerRescueTestJSON-513474333-project-member] Enqueued Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 1069.221832] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae31dacc-8242-4331-8786-1526682530bd with Priority: HIGHEST for action security_group_members [ 1069.222255] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae31dacc-8242-4331-8786-1526682530bd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.222590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.222590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.222737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.222976] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.223294] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.223459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.223765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.223901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.224040] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae31dacc-8242-4331-8786-1526682530bd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.727534] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.727696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.727807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.729837] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.751718] env[66730]: INFO networking_nsxv3.common.synchronization [req-7e4022be-f276-4577-8f4c-fdb7d9262e71 req-d6eece3c-4bc4-4735-985e-82f1a69f4537 tempest-ListImageFiltersTestJSON-1967883334 tempest-ListImageFiltersTestJSON-1967883334-project-member] Enqueued Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 1069.753487] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 1069.754348] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.754649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.754970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.755333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.755644] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.755930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.756394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.757844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.757844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.757844] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.761645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.762195] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.763964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.763964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.763964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.763964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.763964] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae31dacc-8242-4331-8786-1526682530bd is going to be updated. [ 1069.830028] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.830028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.830028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.830028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.830028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.839786] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: IN_PROGRESS for 2s [ 1070.152428] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 1070.153057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.265756] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.768434] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.841741] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1070.841741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.272716] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.273123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.273123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.273341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.273502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.273667] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 is going to be updated. [ 1071.307044] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.307044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.307044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.307044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.307515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.318464] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: IN_PROGRESS for 2s [ 1071.850070] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae31dacc-8242-4331-8786-1526682530bd in Status: SUCCESS [ 1071.850260] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae31dacc-8242-4331-8786-1526682530bd deletion is rescheduled due to dependency. [ 1071.850415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae31dacc-8242-4331-8786-1526682530bd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.043608] env[66730]: INFO networking_nsxv3.common.synchronization [req-17033a6a-3e34-4e63-a2cb-db072ec1d66f req-5319e34f-ee82-4a37-8fdd-4444fbebc096 tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1072.043608] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1072.043608] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.043608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.043608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.043608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.043608] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.043608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.043608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.043608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.043608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.043608] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.546159] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.546159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.546692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.546692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.546692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.546810] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.546873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.546937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.547067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.547131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.547219] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 1072.578637] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.578889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.578889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.579106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.579251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.588687] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 1073.332220] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: SUCCESS [ 1073.332450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.636746] env[66730]: INFO networking_nsxv3.common.synchronization [req-a74e1cbe-7b8e-44d4-8b4c-dd415b61e1cc req-79df54a4-f9f1-4adb-9159-5c8acd2f0b93 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1073.637328] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1073.637642] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.637783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.637881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.638288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.638288] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.638435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.638435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.639396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.639396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.639396] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.790017] env[66730]: INFO networking_nsxv3.common.synchronization [req-53e8d57c-8b89-4c93-b1bd-1dc1372340f4 req-fd0af29c-2490-4669-8746-c26381ac1415 tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1073.790585] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1073.790998] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.791278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.791357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.792407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.792407] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.792407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.792407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.792407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.792716] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.792716] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.143026] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.143247] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.143377] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.143806] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.144085] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.144251] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.144370] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.144595] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.144794] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.145128] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.145226] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.145265] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.145354] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.145586] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.145586] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.145726] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.146903] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.147138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.147138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.147282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.147368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.147530] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.147620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.147676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.147821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.147970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.147970] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1074.178033] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.178033] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.178033] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.178033] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.178033] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-14dafee0-2951-4f59-ada3-fa017501fa8d taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.178033] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-14dafee0-2951-4f59-ada3-fa017501fa8d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.178033] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-14dafee0-2951-4f59-ada3-fa017501fa8d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.180693] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-14dafee0-2951-4f59-ada3-fa017501fa8d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.180693] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14dafee0-2951-4f59-ada3-fa017501fa8d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.199826] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.201344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.201344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.201344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.201344] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.214982] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1074.298633] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.359362] env[66730]: INFO networking_nsxv3.common.synchronization [req-14719e21-75aa-4d34-a804-a3de210a598f req-817cfa07-6a99-4cac-9acf-3150188e7376 tempest-ImagesTestJSON-681326034 tempest-ImagesTestJSON-681326034-project-member] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1074.359709] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1074.360050] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.360182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.360249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.360888] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.360888] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.360888] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.360888] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.361251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.361251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.361251] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.604254] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 1074.604254] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 deletion is rescheduled due to dependency. [ 1074.604254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.682374] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.682697] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.682747] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.683098] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.683369] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.683455] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 14dafee0-2951-4f59-ada3-fa017501fa8d not found, creating... [ 1074.683776] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.683973] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.684117] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.684396] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.684559] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.684950] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.685132] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.685282] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.685550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.685714] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.686347] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 14dafee0-2951-4f59-ada3-fa017501fa8d is going to be created. [ 1074.708965] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.709188] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.709352] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.709648] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.709879] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.710120] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-14dafee0-2951-4f59-ada3-fa017501fa8d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.803588] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.864022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.864219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.864263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.864503] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.864564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.864761] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.865083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.865083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.865083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.865341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.865341] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1074.917026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.917226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.917292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.917535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.917797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.929750] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1075.306503] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.306725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.306725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.306926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.307027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.307127] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1075.354746] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.354962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.354962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.355185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.355331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.365142] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1075.418125] env[66730]: INFO networking_nsxv3.common.synchronization [req-a74e1cbe-7b8e-44d4-8b4c-dd415b61e1cc req-3ac6fac7-a3eb-401b-886f-4f94a2e580a1 service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 1075.418333] env[66730]: INFO networking_nsxv3.common.synchronization [req-a74e1cbe-7b8e-44d4-8b4c-dd415b61e1cc req-3ac6fac7-a3eb-401b-886f-4f94a2e580a1 service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1075.418491] env[66730]: INFO networking_nsxv3.common.synchronization [req-a74e1cbe-7b8e-44d4-8b4c-dd415b61e1cc req-3ac6fac7-a3eb-401b-886f-4f94a2e580a1 service nova] Enqueued Resource ID: 14dafee0-2951-4f59-ada3-fa017501fa8d with Priority: HIGHEST for action port [ 1075.419068] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 1075.419210] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1075.419311] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14dafee0-2951-4f59-ada3-fa017501fa8d with Priority: HIGHEST for action port [ 1075.419593] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.419702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.419759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.419968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.420092] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.421055] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.421247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.421397] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-14dafee0-2951-4f59-ada3-fa017501fa8d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.421500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14dafee0-2951-4f59-ada3-fa017501fa8d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.421558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14dafee0-2951-4f59-ada3-fa017501fa8d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.421743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14dafee0-2951-4f59-ada3-fa017501fa8d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.421854] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14dafee0-2951-4f59-ada3-fa017501fa8d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.925109] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.925449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.926659] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14dafee0-2951-4f59-ada3-fa017501fa8d with status ACTIVE [ 1075.926864] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.926992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.927090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.927319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.927426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.927604] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.927719] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.927781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.927943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.928034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.928237] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.928356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.928425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.928586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.928698] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.928809] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14dafee0-2951-4f59-ada3-fa017501fa8d is going to be updated. [ 1075.953675] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.953675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.953675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.953675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.953675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.953675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14dafee0-2951-4f59-ada3-fa017501fa8d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.225011] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 4s [ 1076.942043] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1076.942043] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 deletion is rescheduled due to dependency. [ 1076.942043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.376133] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1077.376351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.239039] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1078.239424] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 1078.239424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.239499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.240097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.240097] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.240281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.240327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.240551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.240729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.240901] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.744382] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.201514] env[66730]: INFO networking_nsxv3.common.synchronization [req-7743bc76-97dc-4ef3-9abe-5a6fcedc878a req-3d4f6693-351a-4593-aefa-69bfce10c47b tempest-ServersTestBootFromVolume-1355893261 tempest-ServersTestBootFromVolume-1355893261-project-member] Enqueued Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_members [ 1079.202292] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_members [ 1079.202509] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0031949-c54e-4110-961e-a682a87e628f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.202587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.202587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.202845] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.203012] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.203134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.203289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.203450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.203538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.203674] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.247707] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.546022] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-782 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.546022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-782" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.546022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-782" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.546022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-782" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.546022] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.546022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.546691] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.547092] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.547376] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.547743] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.547981] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.549601] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.549601] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.549601] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.549601] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.549601] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.574028] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.574028] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1079.574028] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.574028] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-782" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.574420] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-194bc451-93ef-4e6f-b18c-03ad02e7e277 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.574597] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-194bc451-93ef-4e6f-b18c-03ad02e7e277" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.574712] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-194bc451-93ef-4e6f-b18c-03ad02e7e277" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.576048] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-194bc451-93ef-4e6f-b18c-03ad02e7e277" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.576048] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('194bc451-93ef-4e6f-b18c-03ad02e7e277',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.705991] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.706214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.706325] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.706620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.706782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.707064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.707192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.707256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.707469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.707581] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.707661] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0031949-c54e-4110-961e-a682a87e628f already deleted. [ 1079.707761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.750316] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.750535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.750582] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.750799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.750933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.751061] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1079.782986] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.783251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.783251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.783468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.783615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.795249] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1080.077665] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.077889] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.078068] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.078329] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.078532] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.078700] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 194bc451-93ef-4e6f-b18c-03ad02e7e277 not found, creating... [ 1080.078962] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.079138] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.079282] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.079542] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.079742] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.079992] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.080160] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.080286] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.080503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.080756] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.080756] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 194bc451-93ef-4e6f-b18c-03ad02e7e277 is going to be created. [ 1080.101617] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.101830] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.102057] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.102301] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.102521] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.102737] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-194bc451-93ef-4e6f-b18c-03ad02e7e277" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.188000] env[66730]: INFO networking_nsxv3.common.synchronization [req-83b6e224-78d0-4bf2-9a9a-ef55ff9b143d req-34af24d4-737f-4a28-ab4b-b02d48382055 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 1080.188929] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 1080.190271] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.190530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.190659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.191024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.191331] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.191502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.191598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.191861] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.192032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.192274] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.694790] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.197104] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.267408] env[66730]: INFO networking_nsxv3.common.synchronization [req-7743bc76-97dc-4ef3-9abe-5a6fcedc878a req-7e2c91a7-a6c4-4f6f-bbd7-b3c81b8d1f1f service nova] Enqueued Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_rules [ 1081.267408] env[66730]: INFO networking_nsxv3.common.synchronization [req-7743bc76-97dc-4ef3-9abe-5a6fcedc878a req-7e2c91a7-a6c4-4f6f-bbd7-b3c81b8d1f1f service nova] Enqueued Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_members [ 1081.267408] env[66730]: INFO networking_nsxv3.common.synchronization [req-7743bc76-97dc-4ef3-9abe-5a6fcedc878a req-7e2c91a7-a6c4-4f6f-bbd7-b3c81b8d1f1f service nova] Enqueued Resource ID: 194bc451-93ef-4e6f-b18c-03ad02e7e277 with Priority: HIGHEST for action port [ 1081.267408] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_rules [ 1081.267408] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_members [ 1081.267408] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194bc451-93ef-4e6f-b18c-03ad02e7e277 with Priority: HIGHEST for action port [ 1081.267408] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0031949-c54e-4110-961e-a682a87e628f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.268308] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.268565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.268884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.269087] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.270693] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0031949-c54e-4110-961e-a682a87e628f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.270970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.271160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.271452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.271774] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.272052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.273043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.273459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.274021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.274021] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.275051] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-194bc451-93ef-4e6f-b18c-03ad02e7e277 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.275572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-194bc451-93ef-4e6f-b18c-03ad02e7e277" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.277599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-194bc451-93ef-4e6f-b18c-03ad02e7e277" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.277599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-194bc451-93ef-4e6f-b18c-03ad02e7e277" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.277599] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('194bc451-93ef-4e6f-b18c-03ad02e7e277',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.700534] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.700534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.700534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.700534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.700534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.700534] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 is going to be updated. [ 1081.733961] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.737029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.737029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.737029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.737029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.748737] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: IN_PROGRESS for 2s [ 1081.777936] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0031949-c54e-4110-961e-a682a87e628f taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.779731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.779731] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 194bc451-93ef-4e6f-b18c-03ad02e7e277 with status ACTIVE [ 1081.781030] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.781030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.781030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.781030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.781030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.781030] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.781030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.781030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.782494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.782494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.782494] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.782494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.783136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.783136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.783136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.786170] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 194bc451-93ef-4e6f-b18c-03ad02e7e277 is going to be updated. [ 1081.786170] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.806602] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1081.806854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.807106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.807417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.807552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.807671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.807735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.807921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.808009] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.808102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.808217] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.809816] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.809940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.810017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.810238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.810453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.814992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-194bc451-93ef-4e6f-b18c-03ad02e7e277" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.175018] env[66730]: INFO networking_nsxv3.common.synchronization [req-a797e30d-154e-4d90-b1a4-d44d04d7adb5 req-98e48ac4-357b-423a-aa94-fec0910f33ce tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_members [ 1082.175490] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGHEST for action security_group_members [ 1082.176239] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af4fa83-97d6-42c2-b25a-f1300fa319d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.176383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.176448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.176657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.176823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.176978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.176978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.178051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.178051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.178051] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.287579] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.316033] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.316199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.316569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.316569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.316688] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.316755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.316795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.316966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.317064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.317152] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.317316] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.318173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.318274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.318980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.318980] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.318980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.318980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.318980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.318980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.319471] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.319471] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.682661] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.682830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.682893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.683323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.683464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.683704] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.683847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.683913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.684088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.684165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.684251] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 is going to be updated. [ 1082.716525] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.716872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.716872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.716951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.717096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.728819] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 in Status: IN_PROGRESS for 2s [ 1082.793282] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.793782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.793782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.793782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.793782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.794078] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0031949-c54e-4110-961e-a682a87e628f is going to be created. [ 1082.823154] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5330f620-bc9e-4469-a7f3-c664f754a6e9: rpc.has_security_group_logging(os_id): False [ 1082.834027] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.834027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.834027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.834027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.834027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.845980] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.846281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.846281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.846513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.846601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.846894] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.847067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.847174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.847490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.847588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.847798] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.847946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.848061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.848274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.848389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.848691] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.848830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.848950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.849094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.849171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.849258] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1082.851501] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0031949-c54e-4110-961e-a682a87e628f in Status: UNINITIALIZED for 2s [ 1082.949286] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.950271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.950271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.950271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.950271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.975710] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1083.759967] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: SUCCESS [ 1083.759967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.738226] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 in Status: SUCCESS [ 1084.738400] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 deletion is rescheduled due to dependency. [ 1084.738515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.863192] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0031949-c54e-4110-961e-a682a87e628f in Status: SUCCESS [ 1084.864607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.864607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.864607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.866018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.866018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.866018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.866018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.866018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.866018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.866018] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.996244] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1084.996639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.369104] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.719063] env[66730]: INFO networking_nsxv3.common.synchronization [None req-6c9b9d7a-8da5-48f3-824a-103807201a3d None None] Enqueued Resource ID: 4c2cc5f9-fb5b-4d95-8bf8-6ed3d6d398b8 with Priority: HIGHEST for action port [ 1085.719779] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c2cc5f9-fb5b-4d95-8bf8-6ed3d6d398b8 with Priority: HIGHEST for action port [ 1085.721225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c2cc5f9-fb5b-4d95-8bf8-6ed3d6d398b8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.721225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c2cc5f9-fb5b-4d95-8bf8-6ed3d6d398b8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.721225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c2cc5f9-fb5b-4d95-8bf8-6ed3d6d398b8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.721871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c2cc5f9-fb5b-4d95-8bf8-6ed3d6d398b8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.722286] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c2cc5f9-fb5b-4d95-8bf8-6ed3d6d398b8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.873196] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0031949-c54e-4110-961e-a682a87e628f: rpc.has_security_group_logging(os_id): False [ 1085.896224] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.896449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.896449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.896780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.896882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.897267] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.897267] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.897451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.897451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.897540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.897575] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0031949-c54e-4110-961e-a682a87e628f is going to be created. [ 1085.964278] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.964431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.964477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.964679] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.964856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.980386] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0031949-c54e-4110-961e-a682a87e628f in Status: IN_PROGRESS for 2s [ 1086.049867] env[66730]: INFO networking_nsxv3.common.synchronization [req-495ce086-ff00-4f06-a8f6-985d51689d80 req-9ab3ac15-7692-4402-a0b0-85c2ae7775ad tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1086.057543] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1086.058289] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.058289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.058289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.058687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.060018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.060018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.060018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.060018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.060018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.060018] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.227797] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c2cc5f9-fb5b-4d95-8bf8-6ed3d6d398b8 [ 1086.227976] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.228133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.228200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.228425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.228512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.228605] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c2cc5f9-fb5b-4d95-8bf8-6ed3d6d398b8 already deleted. [ 1086.228688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c2cc5f9-fb5b-4d95-8bf8-6ed3d6d398b8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.292200] env[66730]: INFO networking_nsxv3.common.synchronization [req-f9411988-f416-4bc4-9b64-0b6d36c541bc req-d12bd673-ccee-414e-a9de-8ed75ea66990 tempest-ListImageFiltersTestJSON-1967883334 tempest-ListImageFiltersTestJSON-1967883334-project-member] Enqueued Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 1086.292506] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGHEST for action security_group_members [ 1086.292843] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.292976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.294636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.294934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.295074] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.295306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.295306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.295416] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.295504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.295602] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.472115] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.472476] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.475342] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.475396] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.475669] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.475881] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.476015] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.476506] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.476868] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.477256] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1086.477493] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1086.477710] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1086.477941] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1086.478089] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1086.478383] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1086.478607] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.501127] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.501330] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1086.501465] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.501633] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-376" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.502450] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-00c4056a-aea4-4c2e-9fcb-122ee5f227af taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.502644] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-00c4056a-aea4-4c2e-9fcb-122ee5f227af" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.502700] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-00c4056a-aea4-4c2e-9fcb-122ee5f227af" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.503024] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-00c4056a-aea4-4c2e-9fcb-122ee5f227af" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.503154] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00c4056a-aea4-4c2e-9fcb-122ee5f227af',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.567881] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.568063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.568137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.568362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.568454] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.568648] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.568747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.568816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.568954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.569058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.569148] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 1086.614404] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.614633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.614741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.615752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.615752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.625247] env[66730]: INFO networking_nsxv3.common.synchronization [None req-367f4f08-528a-4f52-859a-bbaffcbf2360 tempest-AttachVolumeTestJSON-1280077890 tempest-AttachVolumeTestJSON-1280077890-project-member] Enqueued Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_rules [ 1086.626489] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 1086.626976] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_rules [ 1086.627340] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90b245b6-5e49-420c-897d-4126cd8e7330 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.627462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.627528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.627794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.627851] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90b245b6-5e49-420c-897d-4126cd8e7330',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.760545] env[66730]: INFO networking_nsxv3.common.synchronization [None req-f8345082-4ae5-4fd9-b9b5-81df4758e4a8 tempest-AttachVolumeTestJSON-1280077890 tempest-AttachVolumeTestJSON-1280077890-project-member] Enqueued Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_rules [ 1086.761599] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_rules [ 1086.761599] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90b245b6-5e49-420c-897d-4126cd8e7330 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.761599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.798766] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.798766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.798766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.798766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.799305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.799305] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.799305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.799305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.800202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.800202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.800202] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 is going to be updated. [ 1086.838678] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.838678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.838678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.838678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.839897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.851968] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: IN_PROGRESS for 2s [ 1087.008021] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.008021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.008021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.008021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.008021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.008021] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 00c4056a-aea4-4c2e-9fcb-122ee5f227af not found, creating... [ 1087.008021] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.008021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.008021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.008021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.008021] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.008779] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.008779] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.008779] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.008779] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.012102] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.012332] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 00c4056a-aea4-4c2e-9fcb-122ee5f227af is going to be created. [ 1087.034856] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.034856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.034856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.034856] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.035208] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.035495] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-00c4056a-aea4-4c2e-9fcb-122ee5f227af" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.162037] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.162037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.162037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.162037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.162037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.162037] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90b245b6-5e49-420c-897d-4126cd8e7330 already deleted. [ 1087.162037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.162037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.162037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.162037] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90b245b6-5e49-420c-897d-4126cd8e7330',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.682683] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.682871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.682871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.683113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.683198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.683293] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90b245b6-5e49-420c-897d-4126cd8e7330 already deleted. [ 1087.683371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.763517] env[66730]: INFO networking_nsxv3.common.synchronization [req-495ce086-ff00-4f06-a8f6-985d51689d80 req-b9ecf386-30f1-42b7-ab04-0223c86bec11 service nova] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_rules [ 1087.763697] env[66730]: INFO networking_nsxv3.common.synchronization [req-495ce086-ff00-4f06-a8f6-985d51689d80 req-b9ecf386-30f1-42b7-ab04-0223c86bec11 service nova] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1087.763831] env[66730]: INFO networking_nsxv3.common.synchronization [req-495ce086-ff00-4f06-a8f6-985d51689d80 req-b9ecf386-30f1-42b7-ab04-0223c86bec11 service nova] Enqueued Resource ID: 00c4056a-aea4-4c2e-9fcb-122ee5f227af with Priority: HIGHEST for action port [ 1087.765558] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_rules [ 1087.765698] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1087.766016] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00c4056a-aea4-4c2e-9fcb-122ee5f227af with Priority: HIGHEST for action port [ 1087.766101] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.766223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.766369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.766501] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.766955] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.767528] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.767609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.768077] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-00c4056a-aea4-4c2e-9fcb-122ee5f227af taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.768077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00c4056a-aea4-4c2e-9fcb-122ee5f227af" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.768077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00c4056a-aea4-4c2e-9fcb-122ee5f227af" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.768077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00c4056a-aea4-4c2e-9fcb-122ee5f227af" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.768319] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00c4056a-aea4-4c2e-9fcb-122ee5f227af',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.996959] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0031949-c54e-4110-961e-a682a87e628f in Status: SUCCESS [ 1087.996959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.189524] env[66730]: INFO networking_nsxv3.common.synchronization [None req-eb4e4e98-b973-4610-92c8-844f3c28f188 None None] Enqueued Resource ID: ca31f0ac-0eaa-4092-ac03-1a62f1aa32c3 with Priority: HIGHEST for action port [ 1088.190129] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca31f0ac-0eaa-4092-ac03-1a62f1aa32c3 with Priority: HIGHEST for action port [ 1088.190443] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca31f0ac-0eaa-4092-ac03-1a62f1aa32c3 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.190557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca31f0ac-0eaa-4092-ac03-1a62f1aa32c3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.190620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca31f0ac-0eaa-4092-ac03-1a62f1aa32c3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.190946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca31f0ac-0eaa-4092-ac03-1a62f1aa32c3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.191067] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca31f0ac-0eaa-4092-ac03-1a62f1aa32c3',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.270111] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.270111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.270317] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00c4056a-aea4-4c2e-9fcb-122ee5f227af with status ACTIVE [ 1088.270484] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.270590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.270656] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.270866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.270950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.271167] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.271510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.271510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.271510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.271702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.271737] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.271878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.271878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.272026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.272063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.272173] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00c4056a-aea4-4c2e-9fcb-122ee5f227af is going to be updated. [ 1088.296476] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.296476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.296476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.296476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.296476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.296476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00c4056a-aea4-4c2e-9fcb-122ee5f227af" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.305705] env[66730]: INFO networking_nsxv3.common.synchronization [req-d0be579a-2689-43d1-910e-85e97b30de9e req-6cc10bf5-df74-496b-be0f-6b171710a4a1 tempest-ImagesTestJSON-681326034 tempest-ImagesTestJSON-681326034-project-member] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1088.306312] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1088.306579] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.306688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.306752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.307157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.307341] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.307622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.307622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.307708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.307744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.307820] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.640661] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 1088.640847] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 deletion is rescheduled due to dependency. [ 1088.641027] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.641169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.641446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.641570] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.641688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.641753] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.641904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.641993] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.642114] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.693263] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca31f0ac-0eaa-4092-ac03-1a62f1aa32c3 [ 1088.693508] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.693645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.693716] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.694042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.694206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.694347] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca31f0ac-0eaa-4092-ac03-1a62f1aa32c3 already deleted. [ 1088.694486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca31f0ac-0eaa-4092-ac03-1a62f1aa32c3" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.698183] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-777 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.699027] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.699027] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.699027] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.699027] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.699247] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.699247] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.699426] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.699577] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.699772] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.699882] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.699989] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.700198] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.700334] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.700451] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.700580] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.720548] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.720716] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1088.720853] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.721094] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-777" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.721397] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-3807aea1-66fa-4895-91bc-90390e202a60 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.721568] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-3807aea1-66fa-4895-91bc-90390e202a60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.721687] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-3807aea1-66fa-4895-91bc-90390e202a60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.721999] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-3807aea1-66fa-4895-91bc-90390e202a60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.722171] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3807aea1-66fa-4895-91bc-90390e202a60',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.809894] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.810054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.810122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.810340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.810431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.810619] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.810718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.810780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.810928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.811019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.811138] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1088.867187] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 in Status: SUCCESS [ 1088.867187] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 deletion is rescheduled due to dependency. [ 1088.867187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.867745] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.869251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.869251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.869251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.869251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.878350] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1089.147870] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.227025] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.227025] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.227025] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.227439] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.227439] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.227439] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 3807aea1-66fa-4895-91bc-90390e202a60 not found, creating... [ 1089.227719] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.227976] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.228218] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.228576] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.230041] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.230041] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.230041] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.230041] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.230285] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.230414] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.230659] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 3807aea1-66fa-4895-91bc-90390e202a60 is going to be created. [ 1089.256049] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.256240] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.256397] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.256646] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.257285] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.257285] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-3807aea1-66fa-4895-91bc-90390e202a60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.630676] env[66730]: INFO networking_nsxv3.common.synchronization [req-13710808-3a98-4bd4-a036-bb0a8aed013b req-369dbbce-175a-4f12-8aab-25c33858a898 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1089.631830] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1089.631830] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.631830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.631830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.632136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.632300] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.632373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.632415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.632625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.632714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.632807] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.650495] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.109095] env[66730]: INFO networking_nsxv3.common.synchronization [req-d0be579a-2689-43d1-910e-85e97b30de9e req-6626233c-55f7-4035-81fc-443c50d491a4 service nova] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_rules [ 1090.109095] env[66730]: INFO networking_nsxv3.common.synchronization [req-d0be579a-2689-43d1-910e-85e97b30de9e req-6626233c-55f7-4035-81fc-443c50d491a4 service nova] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1090.109095] env[66730]: INFO networking_nsxv3.common.synchronization [req-d0be579a-2689-43d1-910e-85e97b30de9e req-6626233c-55f7-4035-81fc-443c50d491a4 service nova] Enqueued Resource ID: 3807aea1-66fa-4895-91bc-90390e202a60 with Priority: HIGHEST for action port [ 1090.109095] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_rules [ 1090.109095] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1090.109095] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3807aea1-66fa-4895-91bc-90390e202a60 with Priority: HIGHEST for action port [ 1090.109569] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.110015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.110179] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.110464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.110644] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.113026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.113026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.113026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3807aea1-66fa-4895-91bc-90390e202a60 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.113026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3807aea1-66fa-4895-91bc-90390e202a60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.113026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3807aea1-66fa-4895-91bc-90390e202a60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.113026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3807aea1-66fa-4895-91bc-90390e202a60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.113026] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3807aea1-66fa-4895-91bc-90390e202a60',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.135080] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.135518] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.136531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.136531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.136531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.136531] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.136531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.136531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.136762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.136799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.136915] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1090.155249] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.155417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.155490] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.155660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.155744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.155836] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 1090.165790] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.165945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.166033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.166228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.166403] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.173714] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1090.185499] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.185684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.185684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.185872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.186015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.196186] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 1090.615467] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.615758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.615802] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3807aea1-66fa-4895-91bc-90390e202a60 with status ACTIVE [ 1090.615969] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.616085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.616152] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.616389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.616476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.616643] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.616740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.616829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.617033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.617116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.617412] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.617573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.617611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.617781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.617881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.617968] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3807aea1-66fa-4895-91bc-90390e202a60 is going to be updated. [ 1090.639600] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.639765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.639800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.640037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.640172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.640334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3807aea1-66fa-4895-91bc-90390e202a60" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.762234] env[66730]: INFO networking_nsxv3.common.synchronization [req-25ab0908-4a7d-4075-8bd8-76adde33a347 req-6cc809ad-8c60-4a79-a5f1-21afe1a903b6 tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 1090.762748] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 1090.763099] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.763187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.763235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.763423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.763572] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.763836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.763836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.763938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.764045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.764133] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.890041] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1090.890231] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 deletion is rescheduled due to dependency. [ 1090.890333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.891104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.891104] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.891104] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.891295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.891295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.891875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.892053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.892166] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.178639] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.178882] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.179081] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.179350] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.179614] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.179765] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.179883] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.180796] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.181050] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.181301] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.181451] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.181589] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.181736] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.181854] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.181984] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.182172] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.203096] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.203273] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1091.203436] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.203626] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-453" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.203986] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-f1180f00-66a6-49e0-8e3c-55a0295031ce taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.204179] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-f1180f00-66a6-49e0-8e3c-55a0295031ce" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.204307] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-f1180f00-66a6-49e0-8e3c-55a0295031ce" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.204656] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-f1180f00-66a6-49e0-8e3c-55a0295031ce" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.204795] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1180f00-66a6-49e0-8e3c-55a0295031ce',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.266433] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.395113] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.707445] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.707942] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.707942] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.708091] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.708169] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.708337] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port f1180f00-66a6-49e0-8e3c-55a0295031ce not found, creating... [ 1091.708599] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.708755] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.708871] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.709272] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.709489] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.709981] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.710219] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.710370] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.710692] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.710886] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.711223] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: f1180f00-66a6-49e0-8e3c-55a0295031ce is going to be created. [ 1091.734112] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.734383] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.734579] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.734954] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.735226] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.735471] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-f1180f00-66a6-49e0-8e3c-55a0295031ce" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.768622] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.897047] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.187207] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1092.187510] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 1092.187641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.208140] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 1092.208372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.208558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.208984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.208984] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.209150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.209191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.209467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.209627] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.209732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.209828] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.271590] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.271769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.271831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.272055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.272149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.272275] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 is going to be updated. [ 1092.314055] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.314263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.314263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.314474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.314628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.332883] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: IN_PROGRESS for 2s [ 1092.399434] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.399559] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.399629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.399866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.399966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.400087] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1092.431549] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.431760] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.431883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.432163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.432315] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.443854] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1092.471298] env[66730]: INFO networking_nsxv3.common.synchronization [req-25ab0908-4a7d-4075-8bd8-76adde33a347 req-6127140c-d581-4571-b15f-ba900eb8dc71 service nova] Enqueued Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_rules [ 1092.471473] env[66730]: INFO networking_nsxv3.common.synchronization [req-25ab0908-4a7d-4075-8bd8-76adde33a347 req-6127140c-d581-4571-b15f-ba900eb8dc71 service nova] Enqueued Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 1092.471609] env[66730]: INFO networking_nsxv3.common.synchronization [req-25ab0908-4a7d-4075-8bd8-76adde33a347 req-6127140c-d581-4571-b15f-ba900eb8dc71 service nova] Enqueued Resource ID: f1180f00-66a6-49e0-8e3c-55a0295031ce with Priority: HIGHEST for action port [ 1092.472239] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_rules [ 1092.472379] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 1092.472514] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1180f00-66a6-49e0-8e3c-55a0295031ce with Priority: HIGHEST for action port [ 1092.472804] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.472945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.473028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.473231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.473306] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.474594] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.474642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.474821] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1180f00-66a6-49e0-8e3c-55a0295031ce taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.474928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1180f00-66a6-49e0-8e3c-55a0295031ce" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.474995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1180f00-66a6-49e0-8e3c-55a0295031ce" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.475254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1180f00-66a6-49e0-8e3c-55a0295031ce" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.475254] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1180f00-66a6-49e0-8e3c-55a0295031ce',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.713547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.713828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.713828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.713991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.714186] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.714287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.714352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.714504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.714591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.714680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.714876] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.715259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.715259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.715911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.716092] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.716201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.716268] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.716419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.716502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.716588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.716684] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.978190] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.978345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.978540] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1180f00-66a6-49e0-8e3c-55a0295031ce with status ACTIVE [ 1092.978712] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.978844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.978885] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.979124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.979194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.979371] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.979459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.979605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.979660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.979749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.979903] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.979991] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.980452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.980452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.980452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.980452] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1180f00-66a6-49e0-8e3c-55a0295031ce is going to be updated. [ 1093.003379] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.003529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.003601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.003810] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.003937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.004115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1180f00-66a6-49e0-8e3c-55a0295031ce" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.219486] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f152db72-4e1f-4942-b241-530ee83d9bd1: rpc.has_security_group_logging(os_id): False [ 1093.245832] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.246091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.246091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.246613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.246613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.246613] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.246775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.246775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.246891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.246945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.247174] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.247272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.247317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.247460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.247531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.247799] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.247799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.247967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.248016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.248068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.248152] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 1093.338682] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.338887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.338957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.339202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.339366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.357740] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 1094.343918] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: SUCCESS [ 1094.344260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.344469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.344556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.344749] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.344868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.344933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.345102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.345228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.345282] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.456035] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1094.456783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.456783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.456783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.456783] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.456964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.456964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.457174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.457293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.457872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.457872] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.847936] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.960126] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.960327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.960406] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.960638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.960820] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.960920] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.960984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.961214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.961327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.961423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.961576] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.961671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.961732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.961887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.962035] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.962146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.962194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.962320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.962396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.962477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.962567] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.350530] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.377368] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 1095.377368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.464971] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a7c2214-9790-410b-aab0-021836529ff9: rpc.has_security_group_logging(os_id): False [ 1095.485755] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.485755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.485755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.485755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.485755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.485755] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.485755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.485755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.485755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.485755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.485755] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.486195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.486195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.486195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.486195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.486682] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.486822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.486904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.487250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.487250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.487250] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1095.573206] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.573206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.573380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.573512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.573664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.593745] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1095.855175] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.855395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.855459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.855724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.855825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.855929] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 is going to be updated. [ 1095.888315] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.888493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.888598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.889155] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.889340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.899289] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: IN_PROGRESS for 2s [ 1097.473298] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1097.473576] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1097.613607] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1097.613890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.910842] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: SUCCESS [ 1097.910842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.910996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.911502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.911593] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.911730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.911844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.912070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.912216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.912345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.912450] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.415361] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.918916] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9: rpc.has_security_group_logging(os_id): False [ 1098.940261] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.940443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.940483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.940684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.965586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.965918] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.966059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.966130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.966349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.966864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.966864] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 is going to be updated. [ 1099.034669] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.034669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.034669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.034851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.034934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.048069] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: IN_PROGRESS for 2s [ 1099.607225] env[66730]: INFO networking_nsxv3.common.synchronization [req-684d3732-95b1-4c8a-a6e0-711bfd9b44a7 req-e8e0d38c-8a45-4259-9139-9aa7c5bb96fd tempest-ServerDiskConfigTestJSON-755154249 tempest-ServerDiskConfigTestJSON-755154249-project-member] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1099.607767] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGHEST for action security_group_members [ 1099.608112] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.608236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.608320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.608561] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.608731] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.608854] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.608966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.609146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.609271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.609375] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.026245] env[66730]: INFO networking_nsxv3.common.synchronization [req-6a975fe4-c286-465e-b2f6-456961fec6b3 req-a7c129fd-0de7-49e8-8a0c-0b321b83a610 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 1100.027331] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGHEST for action security_group_members [ 1100.027331] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.027510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.027510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.027712] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.027888] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.027980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.028077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.028233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.028317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.028411] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.112075] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.112238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.112304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.112533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.112625] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.112832] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.112951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.113029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.113212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.113332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.113372] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be updated. [ 1100.152066] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.152066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.152066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.152066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.152066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.166086] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: IN_PROGRESS for 2s [ 1100.531412] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.531565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.531651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.531853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.531945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.532233] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.532233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.532371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.532448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.532526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.532610] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 is going to be updated. [ 1100.561330] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.561511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.561556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.561742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.561881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.588843] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: IN_PROGRESS for 2s [ 1101.061405] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: SUCCESS [ 1101.061638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.176941] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f152db72-4e1f-4942-b241-530ee83d9bd1 in Status: SUCCESS [ 1102.177196] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 deletion is rescheduled due to dependency. [ 1102.177314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.601518] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 in Status: SUCCESS [ 1102.601692] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 deletion is rescheduled due to dependency. [ 1102.601804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.028846] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1105.028846] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1105.507503] env[66730]: INFO networking_nsxv3.common.synchronization [req-4edeea63-cba6-4e0c-aad0-404e2c013018 req-6d522d60-a049-48cf-92a6-ce8bb38cc0ca tempest-AttachVolumeTestJSON-1280077890 tempest-AttachVolumeTestJSON-1280077890-project-member] Enqueued Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_members [ 1105.508137] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_members [ 1105.508468] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b245b6-5e49-420c-897d-4126cd8e7330 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.508594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.508659] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.508913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.509095] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.509194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.509254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.509680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.509812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.509967] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90b245b6-5e49-420c-897d-4126cd8e7330',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.831403] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.831950] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-130" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.831950] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-130" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.832064] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-130" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.832362] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.832556] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.832770] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.832892] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.833254] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.833621] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.833621] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.833716] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.833793] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.833879] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.833979] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.834808] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.856147] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.856147] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1105.856147] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.856147] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-130" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.856147] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-80a0f0ba-51f7-4284-90f1-fb73535cc187 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.856147] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-80a0f0ba-51f7-4284-90f1-fb73535cc187" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.856147] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-80a0f0ba-51f7-4284-90f1-fb73535cc187" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.856147] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-80a0f0ba-51f7-4284-90f1-fb73535cc187" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.856147] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80a0f0ba-51f7-4284-90f1-fb73535cc187',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.012551] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.012748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.012825] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.013081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.013195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.013457] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.013622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.013695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.014594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.014594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.014594] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b245b6-5e49-420c-897d-4126cd8e7330 already deleted. [ 1106.014594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.358272] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.358714] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.358714] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.358888] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.359051] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.359224] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 80a0f0ba-51f7-4284-90f1-fb73535cc187 not found, creating... [ 1106.359546] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.359713] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.359833] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.360068] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.360206] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.360575] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.360755] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.360873] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.361095] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.361232] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.361399] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 80a0f0ba-51f7-4284-90f1-fb73535cc187 is going to be created. [ 1106.382286] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.382573] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.382706] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.383071] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.383313] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.383534] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-80a0f0ba-51f7-4284-90f1-fb73535cc187" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.876184] env[66730]: INFO networking_nsxv3.common.synchronization [req-095e8138-a57b-4194-91f5-e957501a08e0 req-990d22ef-67ef-4d06-a073-b09c25238651 tempest-ServerActionsTestOtherB-1094684457 tempest-ServerActionsTestOtherB-1094684457-project-member] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 1106.876721] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 1106.877175] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.877342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.877491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.877730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.877967] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.878128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.878338] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.878433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.878562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.878694] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.109715] env[66730]: INFO networking_nsxv3.common.synchronization [req-4edeea63-cba6-4e0c-aad0-404e2c013018 req-3a498015-e445-4486-a1c9-d2d86e4dc2cb service nova] Enqueued Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_rules [ 1107.109893] env[66730]: INFO networking_nsxv3.common.synchronization [req-4edeea63-cba6-4e0c-aad0-404e2c013018 req-3a498015-e445-4486-a1c9-d2d86e4dc2cb service nova] Enqueued Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_members [ 1107.110044] env[66730]: INFO networking_nsxv3.common.synchronization [req-4edeea63-cba6-4e0c-aad0-404e2c013018 req-3a498015-e445-4486-a1c9-d2d86e4dc2cb service nova] Enqueued Resource ID: 80a0f0ba-51f7-4284-90f1-fb73535cc187 with Priority: HIGHEST for action port [ 1107.110555] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_rules [ 1107.110691] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_members [ 1107.110791] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a0f0ba-51f7-4284-90f1-fb73535cc187 with Priority: HIGHEST for action port [ 1107.111449] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90b245b6-5e49-420c-897d-4126cd8e7330 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.111518] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.111552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.111737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.111816] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90b245b6-5e49-420c-897d-4126cd8e7330',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.113324] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b245b6-5e49-420c-897d-4126cd8e7330 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.113324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.113324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.113324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.113324] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.113324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.113652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.113652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.113652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.113751] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90b245b6-5e49-420c-897d-4126cd8e7330',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.114632] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-80a0f0ba-51f7-4284-90f1-fb73535cc187 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.115161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80a0f0ba-51f7-4284-90f1-fb73535cc187" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.115161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80a0f0ba-51f7-4284-90f1-fb73535cc187" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.115161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80a0f0ba-51f7-4284-90f1-fb73535cc187" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.115161] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80a0f0ba-51f7-4284-90f1-fb73535cc187',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.381107] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.381499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.381499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.381650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.402989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.403275] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.403373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.403443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.403692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.403869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.404124] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 1107.431956] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.432212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.432306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.432601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.432824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.441628] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 1107.617364] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80a0f0ba-51f7-4284-90f1-fb73535cc187 with status ACTIVE [ 1107.617655] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.617797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.617868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.618097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.618186] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.618353] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.618476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.618520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.618660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.618724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.618907] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.618999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.619071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.619208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.619282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.619391] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80a0f0ba-51f7-4284-90f1-fb73535cc187 is going to be updated. [ 1107.620701] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b245b6-5e49-420c-897d-4126cd8e7330 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.620701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.620817] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90b245b6-5e49-420c-897d-4126cd8e7330',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.643291] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.643452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.643452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.643605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.646958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.646958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80a0f0ba-51f7-4284-90f1-fb73535cc187" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.870173] env[66730]: INFO networking_nsxv3.common.synchronization [req-7f656bf3-4583-404e-9331-9af9d9d0a159 req-74b2cbce-5250-4d93-87ab-552f2baa367c tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1107.870173] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1107.870173] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.870173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.870173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.870173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.870173] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.870173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.870173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.870819] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.871053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.871402] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.123549] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90b245b6-5e49-420c-897d-4126cd8e7330',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.224931] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-223 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.225276] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.225339] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.225631] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.225909] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.226088] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.226225] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.226567] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.226736] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.226959] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1108.227083] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.227190] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.227298] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.227406] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1108.227512] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.227647] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.251740] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.251895] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1108.252046] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.252253] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.252780] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-b9fccc92-df82-454c-aeec-1e9d5446a055 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.252969] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-b9fccc92-df82-454c-aeec-1e9d5446a055" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.253102] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-b9fccc92-df82-454c-aeec-1e9d5446a055" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.253453] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-b9fccc92-df82-454c-aeec-1e9d5446a055" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.253591] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9fccc92-df82-454c-aeec-1e9d5446a055',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.375086] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.625917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.626351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.626351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.626428] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.626998] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.626998] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b245b6-5e49-420c-897d-4126cd8e7330 is going to be created. [ 1108.652900] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.653087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.653126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.653369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.653578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.665168] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b245b6-5e49-420c-897d-4126cd8e7330 in Status: UNINITIALIZED for 2s [ 1108.756850] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.757088] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.757224] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.757575] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.757805] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.758022] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port b9fccc92-df82-454c-aeec-1e9d5446a055 not found, creating... [ 1108.758454] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.758665] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.758829] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.759110] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.759254] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.759597] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.759790] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.759985] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.760231] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.760372] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.760514] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: b9fccc92-df82-454c-aeec-1e9d5446a055 is going to be created. [ 1108.787575] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.787852] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.788027] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.788422] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.788734] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.789043] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-b9fccc92-df82-454c-aeec-1e9d5446a055" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.879454] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.384224] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.384385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.384460] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.384693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.384785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.384890] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1109.416036] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.416036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.416036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.416036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.416036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.427472] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1109.460045] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 1109.460244] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba deletion is rescheduled due to dependency. [ 1109.460357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.558791] env[66730]: INFO networking_nsxv3.common.synchronization [req-7f656bf3-4583-404e-9331-9af9d9d0a159 req-b209dcb5-8639-42dc-b9fc-829056ae2076 service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1109.558940] env[66730]: INFO networking_nsxv3.common.synchronization [req-7f656bf3-4583-404e-9331-9af9d9d0a159 req-b209dcb5-8639-42dc-b9fc-829056ae2076 service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1109.559089] env[66730]: INFO networking_nsxv3.common.synchronization [req-7f656bf3-4583-404e-9331-9af9d9d0a159 req-b209dcb5-8639-42dc-b9fc-829056ae2076 service nova] Enqueued Resource ID: b9fccc92-df82-454c-aeec-1e9d5446a055 with Priority: HIGHEST for action port [ 1109.559829] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1109.559969] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1109.560081] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9fccc92-df82-454c-aeec-1e9d5446a055 with Priority: HIGHEST for action port [ 1109.560386] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.560545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.560578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.560765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.560840] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.562217] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.562303] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.562543] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9fccc92-df82-454c-aeec-1e9d5446a055 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.562641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9fccc92-df82-454c-aeec-1e9d5446a055" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.562701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9fccc92-df82-454c-aeec-1e9d5446a055" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.562879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9fccc92-df82-454c-aeec-1e9d5446a055" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.562952] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9fccc92-df82-454c-aeec-1e9d5446a055',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.044834] env[66730]: INFO networking_nsxv3.common.synchronization [req-ef454480-75e7-4426-9ebd-eef98e139331 req-361b73bf-371e-4c6f-b931-9df5456c1b33 tempest-ImagesTestJSON-681326034 tempest-ImagesTestJSON-681326034-project-member] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1110.045467] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGHEST for action security_group_members [ 1110.045467] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.045587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.045587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.045801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.046034] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.046116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.046275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.046349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.046513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.046513] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.065014] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.065305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.065439] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9fccc92-df82-454c-aeec-1e9d5446a055 with status ACTIVE [ 1110.065577] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.065682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.065745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.065957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.066056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.066225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.066329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.066391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.066526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.066601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.066797] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.066881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.066915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.067063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.067137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.067221] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9fccc92-df82-454c-aeec-1e9d5446a055 is going to be updated. [ 1110.096868] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.097029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.097087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.097286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.097808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.097808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9fccc92-df82-454c-aeec-1e9d5446a055" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.548296] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.548429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.548562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.548745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.548849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.549062] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.549162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.549221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.549491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.549629] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.549741] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be updated. [ 1110.579145] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.579296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.579358] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.579654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.579821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.589381] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: IN_PROGRESS for 2s [ 1110.678485] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b245b6-5e49-420c-897d-4126cd8e7330 in Status: SUCCESS [ 1110.678607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.678766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.678992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.679198] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.679373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.679457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.679626] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.679713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.679791] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.679903] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90b245b6-5e49-420c-897d-4126cd8e7330',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.183138] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90b245b6-5e49-420c-897d-4126cd8e7330',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.438797] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1111.439661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.439661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.439661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.439884] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.440018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.440084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.440251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.440332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.440428] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.687131] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90b245b6-5e49-420c-897d-4126cd8e7330: rpc.has_security_group_logging(os_id): False [ 1111.707880] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.708051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.708114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.708312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.708383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.708633] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.708763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.708821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.708947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.709051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.709144] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90b245b6-5e49-420c-897d-4126cd8e7330 is going to be created. [ 1111.787462] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.787462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.787462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.787462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.787462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.802954] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90b245b6-5e49-420c-897d-4126cd8e7330 in Status: IN_PROGRESS for 2s [ 1111.944706] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.447567] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.600772] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a7c2214-9790-410b-aab0-021836529ff9 in Status: SUCCESS [ 1112.600772] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 deletion is rescheduled due to dependency. [ 1112.600772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.950026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.950332] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.950389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.950664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.950763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.950868] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1112.984597] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.984777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.984859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.985127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.985296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.995794] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1113.146270] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7f4a76a0-eccd-4e3d-9f92-cd7e2a405509 tempest-AttachInterfacesTestJSON-1534179605 tempest-AttachInterfacesTestJSON-1534179605-project-member] Enqueued Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 1113.146840] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f with Priority: HIGHEST for action security_group_members [ 1113.147160] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.147282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.147351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.147552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.147737] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.147834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.147894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.151192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.151422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.151499] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac62f82-b6ef-4c16-a3fd-c268cde0a17f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.654442] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.654835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.654835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.654935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.655041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.655259] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.655355] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.655434] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.655619] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.655697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.655845] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f is going to be updated. [ 1113.687131] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.687331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.687392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.687640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.687832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.708029] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: IN_PROGRESS for 2s [ 1113.820455] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90b245b6-5e49-420c-897d-4126cd8e7330 in Status: SUCCESS [ 1113.820455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.006559] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1115.006860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.007015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.007247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.007440] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.007557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.007615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.007790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.007881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.007967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.008080] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.513494] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.513774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.513919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.514266] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.514550] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.514733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.514857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.515126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.515270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.515420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.515666] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.515862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.515968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.519021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.519333] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.519505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.519555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.520438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.522017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.522017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.522017] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.546316] env[66730]: INFO networking_nsxv3.common.synchronization [req-e0ab03bd-5f13-49b2-b0de-eb84e358fcb0 req-b81cdd4f-fad0-4996-9fa5-e829b0fc3173 tempest-AttachVolumeNegativeTest-838146779 tempest-AttachVolumeNegativeTest-838146779-project-member] Enqueued Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_members [ 1115.547038] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGHEST for action security_group_members [ 1115.547148] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.547272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.547379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.547529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.547675] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.547762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.547822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.547961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.548872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.549084] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.720170] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f in Status: SUCCESS [ 1115.720363] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac62f82-b6ef-4c16-a3fd-c268cde0a17f deletion is rescheduled due to dependency. [ 1115.720475] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac62f82-b6ef-4c16-a3fd-c268cde0a17f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.026191] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3e2980-ed0f-4c18-a149-cded1b258ec9: rpc.has_security_group_logging(os_id): False [ 1116.046978] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.047160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.047231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.047447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.047536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.047735] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.047830] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.047892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.048051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.048136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.048372] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.048463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.048558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.048663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.048736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.048917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.049063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.049063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.049203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.049272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.049374] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1116.052863] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.052863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.052863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.052863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.052863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.053022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.053096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.053267] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.053356] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.053433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.053525] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 is going to be updated. [ 1116.079928] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.080068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.080149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.080352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.080493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.089700] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 in Status: IN_PROGRESS for 2s [ 1116.123590] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.123590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.123590] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.123856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.123856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.142079] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1118.102221] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 in Status: SUCCESS [ 1118.102504] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 deletion is rescheduled due to dependency. [ 1118.102735] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.160052] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1118.160213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.172487] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7b6a674a-9fdc-4093-ae41-698696047098 None None] Enqueued Resource ID: b74acd3f-940b-42ba-aedf-e141a2110833 with Priority: HIGHEST for action port [ 1118.172831] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74acd3f-940b-42ba-aedf-e141a2110833 with Priority: HIGHEST for action port [ 1118.173276] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b74acd3f-940b-42ba-aedf-e141a2110833 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.173393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b74acd3f-940b-42ba-aedf-e141a2110833" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.173463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b74acd3f-940b-42ba-aedf-e141a2110833" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.173715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b74acd3f-940b-42ba-aedf-e141a2110833" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.173839] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b74acd3f-940b-42ba-aedf-e141a2110833',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.678022] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b74acd3f-940b-42ba-aedf-e141a2110833 [ 1118.678022] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.678022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.678022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.678022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.678022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.678022] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b74acd3f-940b-42ba-aedf-e141a2110833 already deleted. [ 1118.678394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b74acd3f-940b-42ba-aedf-e141a2110833" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.799810] env[66730]: INFO networking_nsxv3.common.synchronization [None req-673b5565-9ea7-4be2-8d7f-6954ca1d8cc0 tempest-ServersTestManualDisk-901239740 tempest-ServersTestManualDisk-901239740-project-member] Enqueued Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_rules [ 1118.801225] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_rules [ 1118.801225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.801225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.801225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.801225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.801225] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c0b7262-514c-4f8f-99ae-f575f19b5ccd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.879140] env[66730]: INFO networking_nsxv3.common.synchronization [None req-2f77481b-c584-4eca-ab10-b749980c615c tempest-ServersTestManualDisk-901239740 tempest-ServersTestManualDisk-901239740-project-member] Enqueued Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_rules [ 1118.879140] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_rules [ 1118.879140] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.879406] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.325966] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.325966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.325966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.325966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.325966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.325966] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd already deleted. [ 1119.325966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.325966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.325966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.325966] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c0b7262-514c-4f8f-99ae-f575f19b5ccd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.849755] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.849961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.850052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.850307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.850407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.850531] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd already deleted. [ 1119.851088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.714320] env[66730]: INFO networking_nsxv3.common.synchronization [None req-b812fe69-247a-4d05-a241-a313b688139a None None] Enqueued Resource ID: 06b43a4c-5b83-4d18-b751-6c9fb695efda with Priority: HIGHEST for action port [ 1120.715066] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b43a4c-5b83-4d18-b751-6c9fb695efda with Priority: HIGHEST for action port [ 1120.715376] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-06b43a4c-5b83-4d18-b751-6c9fb695efda taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.715496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06b43a4c-5b83-4d18-b751-6c9fb695efda" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.715560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06b43a4c-5b83-4d18-b751-6c9fb695efda" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.715829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06b43a4c-5b83-4d18-b751-6c9fb695efda" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.715928] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06b43a4c-5b83-4d18-b751-6c9fb695efda',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.218524] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06b43a4c-5b83-4d18-b751-6c9fb695efda [ 1121.218764] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.219661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.219661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.219661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.219661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.219661] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06b43a4c-5b83-4d18-b751-6c9fb695efda already deleted. [ 1121.219661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06b43a4c-5b83-4d18-b751-6c9fb695efda" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.334922] env[66730]: INFO networking_nsxv3.common.synchronization [req-8230fc4d-9645-4b67-9252-cddf4d38e46c req-1e114406-d6f4-4d29-872c-8c0dff4db400 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1124.335918] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1124.336249] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.336409] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.336500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.336725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.338880] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.338880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.338880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.338880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.338880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.338880] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.677757] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.677950] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.678092] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.678374] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.678639] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.678796] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.678909] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.679309] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.679564] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.679794] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1124.679911] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.680033] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.680141] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.680248] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1124.680352] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.680485] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.700801] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.700967] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1124.701120] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.701297] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-602" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.701654] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-06c37647-827f-4c23-a116-0dc2e88c988c taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.701848] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-06c37647-827f-4c23-a116-0dc2e88c988c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.701967] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-06c37647-827f-4c23-a116-0dc2e88c988c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.702307] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-06c37647-827f-4c23-a116-0dc2e88c988c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.702443] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06c37647-827f-4c23-a116-0dc2e88c988c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.841673] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.841796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.841840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.842069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.842154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.842532] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.842532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.842532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.842749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.842792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.842876] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1124.873853] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.873853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.874082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.874221] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.874399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.884781] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1125.204819] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.205072] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.205187] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.205476] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.205814] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.205814] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 06c37647-827f-4c23-a116-0dc2e88c988c not found, creating... [ 1125.206030] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.206182] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.206316] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.206503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.206637] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.206918] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.207078] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.207202] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.207405] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.207533] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.207668] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 06c37647-827f-4c23-a116-0dc2e88c988c is going to be created. [ 1125.230479] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.230688] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.230810] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.231118] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.231339] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.231551] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-06c37647-827f-4c23-a116-0dc2e88c988c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.963947] env[66730]: INFO networking_nsxv3.common.synchronization [req-8230fc4d-9645-4b67-9252-cddf4d38e46c req-200aa30c-6309-41b6-b064-58df33e9cc56 service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 1125.964232] env[66730]: INFO networking_nsxv3.common.synchronization [req-8230fc4d-9645-4b67-9252-cddf4d38e46c req-200aa30c-6309-41b6-b064-58df33e9cc56 service nova] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1125.964232] env[66730]: INFO networking_nsxv3.common.synchronization [req-8230fc4d-9645-4b67-9252-cddf4d38e46c req-200aa30c-6309-41b6-b064-58df33e9cc56 service nova] Enqueued Resource ID: 06c37647-827f-4c23-a116-0dc2e88c988c with Priority: HIGHEST for action port [ 1125.965214] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_rules [ 1125.965214] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1125.965214] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c37647-827f-4c23-a116-0dc2e88c988c with Priority: HIGHEST for action port [ 1125.965540] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.965736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.966530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.966530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.966530] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.967639] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.967807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.968131] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-06c37647-827f-4c23-a116-0dc2e88c988c taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.968238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06c37647-827f-4c23-a116-0dc2e88c988c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.968305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06c37647-827f-4c23-a116-0dc2e88c988c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.968550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06c37647-827f-4c23-a116-0dc2e88c988c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.968654] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06c37647-827f-4c23-a116-0dc2e88c988c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.471261] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.471390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.471640] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06c37647-827f-4c23-a116-0dc2e88c988c with status ACTIVE [ 1126.471818] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.471994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.471994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.472208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.472296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.472460] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.472554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.472615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.472767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.472841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.473036] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.473137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.473198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.473336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.473410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.473505] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06c37647-827f-4c23-a116-0dc2e88c988c is going to be updated. [ 1126.501078] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.501226] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.501300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.501520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.501722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.501882] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06c37647-827f-4c23-a116-0dc2e88c988c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.895782] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1126.896232] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 1126.896232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.896429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.896799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.897091] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.897256] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.897351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.897645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.897779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.897949] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.401177] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.903695] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.406950] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.407249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.407249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.407420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.407506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.407606] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1128.438337] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.438483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.438571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.438759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.438902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.448469] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1128.550583] env[66730]: INFO networking_nsxv3.common.synchronization [req-a2f135c0-9957-4098-aa21-2bae594c9eba req-20526afa-a5c1-429b-831d-7ede1ced5e09 tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1128.551204] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1128.551521] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.551711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.551790] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.551984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.553027] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.553230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.553309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.553724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.553831] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.554437] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.917149] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-223 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.917554] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.917772] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.918210] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.919700] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.920307] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.920307] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.921401] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.921720] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.922230] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1128.922484] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.922694] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.923682] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.923682] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1128.923875] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.924070] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.949307] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.949307] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1128.949463] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.949613] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.950062] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-619b03d4-7f4e-4c2a-85a8-2c9248816d67 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.950261] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-619b03d4-7f4e-4c2a-85a8-2c9248816d67" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.950385] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-619b03d4-7f4e-4c2a-85a8-2c9248816d67" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.950883] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-619b03d4-7f4e-4c2a-85a8-2c9248816d67" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.950883] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('619b03d4-7f4e-4c2a-85a8-2c9248816d67',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.056149] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.453413] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.453809] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.453809] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.454037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.454191] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.454343] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 619b03d4-7f4e-4c2a-85a8-2c9248816d67 not found, creating... [ 1129.454600] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.454751] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.454906] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.455426] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.455569] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.455854] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.456015] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.456154] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.456360] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.456488] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.456623] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 619b03d4-7f4e-4c2a-85a8-2c9248816d67 is going to be created. [ 1129.477351] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.477558] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.477682] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.477952] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.478199] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.478420] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-619b03d4-7f4e-4c2a-85a8-2c9248816d67" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.559442] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.647939] env[66730]: INFO networking_nsxv3.common.synchronization [req-d5e376d6-5b87-414f-8cb6-4dc7ba9778bd req-93582a3a-89e4-4102-8cc8-f31745fde42b tempest-ServersTestBootFromVolume-1355893261 tempest-ServersTestBootFromVolume-1355893261-project-member] Enqueued Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_members [ 1129.648149] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGHEST for action security_group_members [ 1129.648450] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0031949-c54e-4110-961e-a682a87e628f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.648573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.648640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.648840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.649050] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.649127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.649223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.649329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.649414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.649503] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.062819] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.062956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.063064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.065562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.065562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.065562] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1130.093481] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.093663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.093771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.093995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.094147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.105238] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1130.153183] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.153383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.153491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.153744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.153863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.154113] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.154236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.154333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.154516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.154616] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.154721] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0031949-c54e-4110-961e-a682a87e628f is going to be updated. [ 1130.185357] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.185516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.186302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.186302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.186302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.195563] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0031949-c54e-4110-961e-a682a87e628f in Status: IN_PROGRESS for 2s [ 1130.232549] env[66730]: INFO networking_nsxv3.common.synchronization [req-a2f135c0-9957-4098-aa21-2bae594c9eba req-3cbd7f79-f28c-4161-815e-b26fb6b49811 service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1130.232720] env[66730]: INFO networking_nsxv3.common.synchronization [req-a2f135c0-9957-4098-aa21-2bae594c9eba req-3cbd7f79-f28c-4161-815e-b26fb6b49811 service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1130.232898] env[66730]: INFO networking_nsxv3.common.synchronization [req-a2f135c0-9957-4098-aa21-2bae594c9eba req-3cbd7f79-f28c-4161-815e-b26fb6b49811 service nova] Enqueued Resource ID: 619b03d4-7f4e-4c2a-85a8-2c9248816d67 with Priority: HIGHEST for action port [ 1130.233443] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1130.233595] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1130.233667] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619b03d4-7f4e-4c2a-85a8-2c9248816d67 with Priority: HIGHEST for action port [ 1130.234093] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.234310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.234390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.234671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.234749] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.235976] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.236094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.236369] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-619b03d4-7f4e-4c2a-85a8-2c9248816d67 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.236514] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-619b03d4-7f4e-4c2a-85a8-2c9248816d67" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.236618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-619b03d4-7f4e-4c2a-85a8-2c9248816d67" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.236856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-619b03d4-7f4e-4c2a-85a8-2c9248816d67" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.236966] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('619b03d4-7f4e-4c2a-85a8-2c9248816d67',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.459782] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1130.460126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.460400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.460684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.460951] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.461099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.461168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.461351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.461599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.461771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.461875] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.738661] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.738881] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.738998] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 619b03d4-7f4e-4c2a-85a8-2c9248816d67 with status ACTIVE [ 1130.739236] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.739329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.739431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.739697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.739824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.740093] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.740235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.740328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.740528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.740646] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.740800] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.740907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.740955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.741147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.741237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.741362] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 619b03d4-7f4e-4c2a-85a8-2c9248816d67 is going to be updated. [ 1130.764703] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.764924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.764924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.765159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.765300] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.765462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-619b03d4-7f4e-4c2a-85a8-2c9248816d67" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.954667] env[66730]: INFO networking_nsxv3.common.synchronization [req-417f522c-b8f3-48a8-9230-54a87f72763b req-9c46132a-dacb-4bcb-abb4-4669cd46a9f7 tempest-ServersTestManualDisk-901239740 tempest-ServersTestManualDisk-901239740-project-member] Enqueued Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_members [ 1130.955325] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_members [ 1130.955900] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.955900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.955900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.956088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.956442] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.956442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.956442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.956672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.956672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.956762] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c0b7262-514c-4f8f-99ae-f575f19b5ccd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.964054] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.964054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.964054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.964292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.964741] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.964741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.964741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.964910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.964910] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.964971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.965116] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.965210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.965302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.965405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.966505] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.966505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.966505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.966505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.966505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.966505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.966505] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.302601] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-784 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.303195] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-784" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.303404] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-784" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.304166] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-784" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.304489] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.304858] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.305076] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.305854] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.306168] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.306442] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.306598] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.306826] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.307127] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.307318] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.307471] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.307762] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.327679] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.328338] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1131.328579] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.328683] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-784" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.329079] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-3b0e3e4e-ff69-434e-be8f-b78205875bca taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.329195] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-3b0e3e4e-ff69-434e-be8f-b78205875bca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.329320] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-3b0e3e4e-ff69-434e-be8f-b78205875bca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.329644] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-3b0e3e4e-ff69-434e-be8f-b78205875bca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.329806] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b0e3e4e-ff69-434e-be8f-b78205875bca',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.459393] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.459393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.459393] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.459556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.459693] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.460151] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.460412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.460954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.460954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.460954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.460954] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd already deleted. [ 1131.461110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.468839] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5330f620-bc9e-4469-a7f3-c664f754a6e9: rpc.has_security_group_logging(os_id): False [ 1131.495079] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.495079] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.495079] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.495079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.495649] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.495649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.495649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.495649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.495649] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.495649] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1131.558824] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.558999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.559065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.559322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.559499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.585327] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1131.832502] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.832731] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.832957] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.833343] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.833503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.833721] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 3b0e3e4e-ff69-434e-be8f-b78205875bca not found, creating... [ 1131.833990] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.834186] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.834304] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.834522] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.834656] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.835028] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.835199] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.835313] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.835517] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.835652] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.835793] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 3b0e3e4e-ff69-434e-be8f-b78205875bca is going to be created. [ 1131.858340] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.858553] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.858694] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.858951] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.859159] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.859379] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-3b0e3e4e-ff69-434e-be8f-b78205875bca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.115989] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1132.116237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.116425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.116642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.116945] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.117135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.117209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.117377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.117491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.117551] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.205879] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0031949-c54e-4110-961e-a682a87e628f in Status: SUCCESS [ 1132.206063] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0031949-c54e-4110-961e-a682a87e628f deletion is rescheduled due to dependency. [ 1132.206176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.576261] env[66730]: INFO networking_nsxv3.common.synchronization [req-417f522c-b8f3-48a8-9230-54a87f72763b req-e97fdc26-1947-4978-a88b-72dd780c16f1 service nova] Enqueued Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_rules [ 1132.576261] env[66730]: INFO networking_nsxv3.common.synchronization [req-417f522c-b8f3-48a8-9230-54a87f72763b req-e97fdc26-1947-4978-a88b-72dd780c16f1 service nova] Enqueued Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_members [ 1132.576261] env[66730]: INFO networking_nsxv3.common.synchronization [req-417f522c-b8f3-48a8-9230-54a87f72763b req-e97fdc26-1947-4978-a88b-72dd780c16f1 service nova] Enqueued Resource ID: 3b0e3e4e-ff69-434e-be8f-b78205875bca with Priority: HIGHEST for action port [ 1132.576674] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_rules [ 1132.576674] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_members [ 1132.576761] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b0e3e4e-ff69-434e-be8f-b78205875bca with Priority: HIGHEST for action port [ 1132.577090] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.577236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.577657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.577913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.578014] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c0b7262-514c-4f8f-99ae-f575f19b5ccd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.579081] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.579164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.579195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.579389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.579586] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.579686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.579762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.579920] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.580015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.580109] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c0b7262-514c-4f8f-99ae-f575f19b5ccd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.581871] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b0e3e4e-ff69-434e-be8f-b78205875bca taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.581871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b0e3e4e-ff69-434e-be8f-b78205875bca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.582280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b0e3e4e-ff69-434e-be8f-b78205875bca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.582280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b0e3e4e-ff69-434e-be8f-b78205875bca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.582280] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b0e3e4e-ff69-434e-be8f-b78205875bca',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.622052] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.084249] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.084432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.084667] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c0b7262-514c-4f8f-99ae-f575f19b5ccd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.085865] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b0e3e4e-ff69-434e-be8f-b78205875bca with status ACTIVE [ 1133.086068] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.086204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.086314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.086562] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.086703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.086948] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.087701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.087701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.088071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.088071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.088297] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.088462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.088537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.088828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.088915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.088974] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b0e3e4e-ff69-434e-be8f-b78205875bca is going to be updated. [ 1133.118629] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.118780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.118936] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.119097] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.119235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.119394] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b0e3e4e-ff69-434e-be8f-b78205875bca" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.124869] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.289211] env[66730]: INFO networking_nsxv3.common.synchronization [req-58d05a7c-c79a-455a-bef9-dc7593120d60 req-01edace8-6e00-4d6e-a3d9-94d7ec157502 tempest-ServerActionsTestOtherB-1094684457 tempest-ServerActionsTestOtherB-1094684457-project-member] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 1133.289760] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 1133.290109] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.290187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.290272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.290453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.290602] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.290701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.290774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.290889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.290961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.291072] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.591100] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c0b7262-514c-4f8f-99ae-f575f19b5ccd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.622541] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1133.622541] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.627388] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.627388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.627388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.627690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.627775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.627986] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1133.635473] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.635675] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.635798] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.636198] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.636370] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.636527] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.636639] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.637530] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.637530] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.637530] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.637530] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.637530] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.637796] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.637796] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.637796] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.637899] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.661155] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.661791] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1133.661893] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.662187] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.662681] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.663032] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.663292] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.664205] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.664205] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2bae48a-d631-400a-bcf8-8b310cb6e2ec',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.666699] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.666877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.666981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.667516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.667516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.677753] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1133.795137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.795137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.795137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.796206] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.796354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.796826] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.797942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.797942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.797942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.797942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.797942] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 1133.828359] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.828600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.828600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.828981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.828981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.840940] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 1134.093631] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.093894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.093957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.094278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.094404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.094500] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd is going to be created. [ 1134.122081] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.122306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.122306] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.122530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.122709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.132260] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd in Status: UNINITIALIZED for 2s [ 1134.169849] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.170259] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.170576] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.170768] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.170949] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.171242] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port f2bae48a-d631-400a-bcf8-8b310cb6e2ec not found, creating... [ 1134.171676] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.171982] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.172150] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.172395] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.172608] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.172904] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.173158] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.173334] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.173659] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.173763] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.173967] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: f2bae48a-d631-400a-bcf8-8b310cb6e2ec is going to be created. [ 1134.194916] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.195146] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.195274] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.195626] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.195783] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.196022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.893818] env[66730]: INFO networking_nsxv3.common.synchronization [req-58d05a7c-c79a-455a-bef9-dc7593120d60 req-b66f3712-8d4a-4202-87d8-7082d7e26008 service nova] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 1134.894152] env[66730]: INFO networking_nsxv3.common.synchronization [req-58d05a7c-c79a-455a-bef9-dc7593120d60 req-b66f3712-8d4a-4202-87d8-7082d7e26008 service nova] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 1134.894152] env[66730]: INFO networking_nsxv3.common.synchronization [req-58d05a7c-c79a-455a-bef9-dc7593120d60 req-b66f3712-8d4a-4202-87d8-7082d7e26008 service nova] Enqueued Resource ID: f2bae48a-d631-400a-bcf8-8b310cb6e2ec with Priority: HIGHEST for action port [ 1134.894749] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 1134.894749] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 1134.894832] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2bae48a-d631-400a-bcf8-8b310cb6e2ec with Priority: HIGHEST for action port [ 1134.896013] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.896087] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.896137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.896341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.896526] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.897386] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.897520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.897693] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.897835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.897923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.898121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.898198] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2bae48a-d631-400a-bcf8-8b310cb6e2ec',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.400275] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.400536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.400881] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2bae48a-d631-400a-bcf8-8b310cb6e2ec with status ACTIVE [ 1135.401528] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.401528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.401528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.402039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.402039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.402352] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.402519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.402623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.402894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.403049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.403350] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.403515] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.403739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.403987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.404158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.404378] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2bae48a-d631-400a-bcf8-8b310cb6e2ec is going to be updated. [ 1135.431922] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.432162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.432261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.432508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.432682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.432892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.691322] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1135.691322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.691322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.691322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.691322] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.691322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.691322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.691322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.691322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.691322] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.691322] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.854556] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 1135.854556] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba deletion is rescheduled due to dependency. [ 1135.854556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.854556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.854556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.854556] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.854556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.854927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.854927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.854927] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.855909] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.144320] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd in Status: SUCCESS [ 1136.144598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.144703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.144924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.145144] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.145263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.145389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.145488] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.145566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.145652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.145739] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c0b7262-514c-4f8f-99ae-f575f19b5ccd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.198676] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.198826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.198898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.199132] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.199303] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.199400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.199463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.199604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.199690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.199780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.199928] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.200037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.200100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.200294] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.200454] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.200548] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.200604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.200751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.200829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.200908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.201047] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.357924] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.648628] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c0b7262-514c-4f8f-99ae-f575f19b5ccd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.704550] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3e2980-ed0f-4c18-a149-cded1b258ec9: rpc.has_security_group_logging(os_id): False [ 1136.725726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.725967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.726093] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.726354] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.726453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.726678] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.726775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.726843] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.727218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.727218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.727343] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.727401] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.727448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.727586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.727658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.727836] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.727933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.727994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.728141] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.728212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.728295] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1136.792222] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.792462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.792575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.792897] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.793159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.811015] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1136.860610] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.150464] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c0b7262-514c-4f8f-99ae-f575f19b5ccd: rpc.has_security_group_logging(os_id): False [ 1137.169052] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.169052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.169052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.169400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.169400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.169470] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.169568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.169684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.169801] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.169889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.169974] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd is going to be created. [ 1137.232806] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.232989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.233050] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.233253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.233505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.244790] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd in Status: IN_PROGRESS for 2s [ 1137.362975] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.363209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.363284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.363507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.363596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.363698] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 1137.403978] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.403978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.403978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.403978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.403978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.410870] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 1138.831147] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1138.831147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.258410] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd in Status: SUCCESS [ 1139.258766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.422796] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 1139.422982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.423174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.423458] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.423703] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.423875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.423944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.424264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.424352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.424468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.424750] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.895835] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1139.896557] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1139.926694] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.430019] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a55c2a9-6077-4f76-8e80-8d941329a6ba: rpc.has_security_group_logging(os_id): False [ 1140.450789] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.451106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.451189] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.451445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.451567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.451907] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.452048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.452121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.452405] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.452487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.452578] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 1140.516879] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.517100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.517178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.517473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.517737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.539809] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 1142.555302] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 1142.555302] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.174189] env[66730]: INFO networking_nsxv3.common.synchronization [None req-3bed284e-6165-42a4-abf5-99b074025191 None None] Enqueued Resource ID: 9f6c9e6f-3004-4d23-8355-08f11ec863f7 with Priority: HIGHEST for action port [ 1143.174739] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f6c9e6f-3004-4d23-8355-08f11ec863f7 with Priority: HIGHEST for action port [ 1143.175044] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f6c9e6f-3004-4d23-8355-08f11ec863f7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.175172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f6c9e6f-3004-4d23-8355-08f11ec863f7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.175729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f6c9e6f-3004-4d23-8355-08f11ec863f7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.175729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f6c9e6f-3004-4d23-8355-08f11ec863f7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.175729] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f6c9e6f-3004-4d23-8355-08f11ec863f7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.262450] env[66730]: INFO networking_nsxv3.common.synchronization [None req-458be55a-39f0-43a7-b5b3-1a93379881f1 tempest-ServersTestJSON-1508465953 tempest-ServersTestJSON-1508465953-project-member] Enqueued Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_rules [ 1143.263053] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_rules [ 1143.263383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aa77707-f5c7-48ed-9703-9e099c01463b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.263531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.263587] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.263813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.263913] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.343833] env[66730]: INFO networking_nsxv3.common.synchronization [None req-72f99885-306f-4003-b399-81f348a7882e tempest-ServersTestJSON-1508465953 tempest-ServersTestJSON-1508465953-project-member] Enqueued Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_rules [ 1143.344413] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_rules [ 1143.344765] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aa77707-f5c7-48ed-9703-9e099c01463b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.345268] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.413646] env[66730]: INFO networking_nsxv3.common.synchronization [req-7a761017-4058-491f-a983-94b790d1b057 req-4823802b-887b-47c7-90a2-998f80c794d2 tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1143.413646] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1143.413763] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.413863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.413922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.414543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.414543] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.414543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.414715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.414782] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.414839] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.415092] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.678687] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f6c9e6f-3004-4d23-8355-08f11ec863f7 [ 1143.678969] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.679125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.679192] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.679415] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.679502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.679606] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f6c9e6f-3004-4d23-8355-08f11ec863f7 already deleted. [ 1143.679688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f6c9e6f-3004-4d23-8355-08f11ec863f7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.789462] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.789462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.789462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.789462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.789462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.789462] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aa77707-f5c7-48ed-9703-9e099c01463b already deleted. [ 1143.789462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.789462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.789462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.789462] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.921176] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.310211] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.310367] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.310437] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.310655] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.310743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.310973] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aa77707-f5c7-48ed-9703-9e099c01463b already deleted. [ 1144.310973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.422624] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.925608] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.926327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.926553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.926904] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.928049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.928310] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1144.962788] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.962938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.963022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.963430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.963430] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.974420] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1146.318210] env[66730]: INFO networking_nsxv3.common.synchronization [None req-839e7416-0fea-4653-b9e4-f4461a0d0e38 None None] Enqueued Resource ID: c9c554be-ecda-4744-ab3f-0d4a0751ac5a with Priority: HIGHEST for action port [ 1146.319188] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c554be-ecda-4744-ab3f-0d4a0751ac5a with Priority: HIGHEST for action port [ 1146.319549] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9c554be-ecda-4744-ab3f-0d4a0751ac5a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.319702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9c554be-ecda-4744-ab3f-0d4a0751ac5a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.319828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9c554be-ecda-4744-ab3f-0d4a0751ac5a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.320111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9c554be-ecda-4744-ab3f-0d4a0751ac5a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.320234] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9c554be-ecda-4744-ab3f-0d4a0751ac5a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.823315] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9c554be-ecda-4744-ab3f-0d4a0751ac5a [ 1146.823491] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.823619] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.823676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.823894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.823985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.824095] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9c554be-ecda-4744-ab3f-0d4a0751ac5a already deleted. [ 1146.824177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9c554be-ecda-4744-ab3f-0d4a0751ac5a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.987617] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1146.987872] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.949039] env[66730]: INFO networking_nsxv3.common.synchronization [req-85742842-68c6-4428-9a4b-73347b287c82 req-023563b8-f91e-4ac0-8906-53a04fcac73a tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1147.949590] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1147.949899] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.950032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.950095] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.950329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.950483] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.950583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.950642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.950785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.950866] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.950960] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.452777] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.453033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.453122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.453291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.474715] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.474959] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.475111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.475171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.475346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.475421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.475515] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be updated. [ 1148.502010] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.502154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.502195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.502470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.502617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.512152] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 1150.525178] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 1150.525509] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 deletion is rescheduled due to dependency. [ 1150.525509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.834761] env[66730]: INFO networking_nsxv3.common.synchronization [req-ba551573-a734-49c5-90ff-3405c91d111b req-a2d538c6-fab7-4c81-8771-3b1338794a09 tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1151.835545] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1151.835991] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.836194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.836310] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.836886] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.836886] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.837149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.837149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.837353] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.837540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.837644] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.075587] env[66730]: INFO networking_nsxv3.common.synchronization [req-6c21c900-d980-4a0f-bbf2-87ad1c73f33d req-681abad6-69d4-4ae2-8888-48c23d6a4e80 tempest-ServersTestJSON-1508465953 tempest-ServersTestJSON-1508465953-project-member] Enqueued Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_members [ 1152.075981] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_members [ 1152.076651] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aa77707-f5c7-48ed-9703-9e099c01463b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.076651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.076651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.077014] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.077317] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.077411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.077563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.077755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.077841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.077933] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.340523] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.477547] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.478320] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-530" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.478320] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-530" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.478320] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-530" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.478457] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.478644] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.478719] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.478934] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.479092] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.479317] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.479626] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.479669] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.479972] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.480042] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.481390] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.481390] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.504309] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.504309] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.504511] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.504620] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-530" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.504963] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-4e55eb2f-392c-4916-952c-1ae98b31218a taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.505416] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-4e55eb2f-392c-4916-952c-1ae98b31218a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.505416] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-4e55eb2f-392c-4916-952c-1ae98b31218a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.505611] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-4e55eb2f-392c-4916-952c-1ae98b31218a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.505747] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e55eb2f-392c-4916-952c-1ae98b31218a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.579934] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.580232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.580329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.580610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.580695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.580920] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.581043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.581099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.581267] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.581366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.581456] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aa77707-f5c7-48ed-9703-9e099c01463b already deleted. [ 1152.581540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.846139] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.007985] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.008256] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.008391] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.008683] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.008832] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.009039] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 4e55eb2f-392c-4916-952c-1ae98b31218a not found, creating... [ 1153.009263] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.009419] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.009533] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.009769] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.009944] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.010252] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.010450] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.010606] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.010868] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.011072] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.011252] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 4e55eb2f-392c-4916-952c-1ae98b31218a is going to be created. [ 1153.033867] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.033867] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.033867] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.034123] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.034334] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.034457] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-4e55eb2f-392c-4916-952c-1ae98b31218a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.348222] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.348412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.348455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.348661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.348746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.348844] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1153.377837] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.378071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.378071] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.378257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.378400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.387786] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1153.748722] env[66730]: INFO networking_nsxv3.common.synchronization [req-6c21c900-d980-4a0f-bbf2-87ad1c73f33d req-ccde3c5e-f636-4add-80bc-99f760b5b8ea service nova] Enqueued Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_rules [ 1153.749160] env[66730]: INFO networking_nsxv3.common.synchronization [req-6c21c900-d980-4a0f-bbf2-87ad1c73f33d req-ccde3c5e-f636-4add-80bc-99f760b5b8ea service nova] Enqueued Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_members [ 1153.749160] env[66730]: INFO networking_nsxv3.common.synchronization [req-6c21c900-d980-4a0f-bbf2-87ad1c73f33d req-ccde3c5e-f636-4add-80bc-99f760b5b8ea service nova] Enqueued Resource ID: 4e55eb2f-392c-4916-952c-1ae98b31218a with Priority: HIGHEST for action port [ 1153.749624] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_rules [ 1153.749756] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_members [ 1153.749846] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e55eb2f-392c-4916-952c-1ae98b31218a with Priority: HIGHEST for action port [ 1153.750138] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aa77707-f5c7-48ed-9703-9e099c01463b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.750362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.750362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.750651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.750651] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.751771] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aa77707-f5c7-48ed-9703-9e099c01463b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.751892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.751950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.752453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.752453] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.752453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.753215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.753215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.753215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.753215] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.753820] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e55eb2f-392c-4916-952c-1ae98b31218a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.753820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e55eb2f-392c-4916-952c-1ae98b31218a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.753820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e55eb2f-392c-4916-952c-1ae98b31218a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.753973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e55eb2f-392c-4916-952c-1ae98b31218a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.754048] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e55eb2f-392c-4916-952c-1ae98b31218a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.256987] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aa77707-f5c7-48ed-9703-9e099c01463b taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.257339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.257392] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.258250] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e55eb2f-392c-4916-952c-1ae98b31218a with status ACTIVE [ 1154.258885] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.258885] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.258885] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.258885] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.258885] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.259170] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.259170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.259250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.259328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.259459] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.259652] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.259744] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.259802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.259960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.260064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.260149] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e55eb2f-392c-4916-952c-1ae98b31218a is going to be updated. [ 1154.304696] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.304696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.304696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.304980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.304980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.305106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e55eb2f-392c-4916-952c-1ae98b31218a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.762431] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.265195] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.265642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.265642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.265642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.265736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.265879] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aa77707-f5c7-48ed-9703-9e099c01463b is going to be created. [ 1155.306009] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.306286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.306286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.306645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.306847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.319201] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aa77707-f5c7-48ed-9703-9e099c01463b in Status: UNINITIALIZED for 2s [ 1155.399600] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1155.399860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.329011] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aa77707-f5c7-48ed-9703-9e099c01463b in Status: SUCCESS [ 1157.329348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.329348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.329601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.329823] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.330028] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.330142] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.330347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.330497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.330623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.330750] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.833451] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.336476] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2aa77707-f5c7-48ed-9703-9e099c01463b: rpc.has_security_group_logging(os_id): False [ 1158.358620] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.358799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.358915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.359200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.359314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.359580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.359677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.359740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.359901] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.359975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.360090] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aa77707-f5c7-48ed-9703-9e099c01463b is going to be created. [ 1158.421568] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.421820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.421820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.422243] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.422440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.438133] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aa77707-f5c7-48ed-9703-9e099c01463b in Status: IN_PROGRESS for 2s [ 1158.697374] env[66730]: INFO networking_nsxv3.common.synchronization [req-6bafee84-5000-4104-b94a-f394612def0b req-708a81c7-7b40-4d1d-9ccd-85d60a73e0a0 tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1158.697918] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1158.698494] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.698643] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.698755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.699089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.699363] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.699532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.699645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.699906] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.700067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.700221] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.046880] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.047122] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.047562] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.047882] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.048191] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.048351] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.048470] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.048703] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.048851] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.049076] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.049195] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.049302] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.049406] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.049511] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.049612] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.049738] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.072165] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.072626] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1159.072626] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.072789] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.073497] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-c11f0cd3-4e00-4a46-9945-7c2fe54cac61 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.073497] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-c11f0cd3-4e00-4a46-9945-7c2fe54cac61" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.073497] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-c11f0cd3-4e00-4a46-9945-7c2fe54cac61" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.073820] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-c11f0cd3-4e00-4a46-9945-7c2fe54cac61" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.073876] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c11f0cd3-4e00-4a46-9945-7c2fe54cac61',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.205806] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.206026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.206270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.206360] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.206564] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.206662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.206732] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.206884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.206960] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.207066] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be updated. [ 1159.235609] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.235850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.235850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.236033] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.236178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.245864] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 1159.576659] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.577071] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.577071] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.577414] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.577582] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.577740] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port c11f0cd3-4e00-4a46-9945-7c2fe54cac61 not found, creating... [ 1159.578017] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.578180] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.578296] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.578521] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.578656] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.578933] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.579100] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.579217] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.579451] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.579588] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.579727] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: c11f0cd3-4e00-4a46-9945-7c2fe54cac61 is going to be created. [ 1159.600323] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.600613] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.600819] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.601143] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.601359] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.601581] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-c11f0cd3-4e00-4a46-9945-7c2fe54cac61" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.329500] env[66730]: INFO networking_nsxv3.common.synchronization [req-6bafee84-5000-4104-b94a-f394612def0b req-df4f7e09-a4ab-4339-90d5-d5b0bee9a73d service nova] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_rules [ 1160.329500] env[66730]: INFO networking_nsxv3.common.synchronization [req-6bafee84-5000-4104-b94a-f394612def0b req-df4f7e09-a4ab-4339-90d5-d5b0bee9a73d service nova] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1160.329774] env[66730]: INFO networking_nsxv3.common.synchronization [req-6bafee84-5000-4104-b94a-f394612def0b req-df4f7e09-a4ab-4339-90d5-d5b0bee9a73d service nova] Enqueued Resource ID: c11f0cd3-4e00-4a46-9945-7c2fe54cac61 with Priority: HIGHEST for action port [ 1160.330116] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_rules [ 1160.330287] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1160.330386] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c11f0cd3-4e00-4a46-9945-7c2fe54cac61 with Priority: HIGHEST for action port [ 1160.330656] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.330774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.330841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.331049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.331133] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.331956] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.332061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.332347] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-c11f0cd3-4e00-4a46-9945-7c2fe54cac61 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.332445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c11f0cd3-4e00-4a46-9945-7c2fe54cac61" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.332486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c11f0cd3-4e00-4a46-9945-7c2fe54cac61" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.332648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c11f0cd3-4e00-4a46-9945-7c2fe54cac61" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.332717] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c11f0cd3-4e00-4a46-9945-7c2fe54cac61',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.451285] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aa77707-f5c7-48ed-9703-9e099c01463b in Status: SUCCESS [ 1160.451539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.835045] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.835373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.835373] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c11f0cd3-4e00-4a46-9945-7c2fe54cac61 with status ACTIVE [ 1160.835540] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.835636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.835708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.835922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.836018] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.836201] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.836298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.836359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.836513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.836589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.836764] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.836853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.836903] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.837056] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.837128] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.837211] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c11f0cd3-4e00-4a46-9945-7c2fe54cac61 is going to be updated. [ 1160.861630] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.861813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.861813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.862051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.862305] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.862407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c11f0cd3-4e00-4a46-9945-7c2fe54cac61" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.256763] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 1161.256950] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 deletion is rescheduled due to dependency. [ 1161.257078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.257238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.257453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.257628] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.257739] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.257813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.257951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.258039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.258135] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.760171] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.262320] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.764870] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.764870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.765375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.765375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.765375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.765475] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be updated. [ 1162.794565] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.794770] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.794900] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.795271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.795439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.805834] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 1162.938450] env[66730]: INFO networking_nsxv3.common.synchronization [req-9a150664-3f3d-4f3f-b13d-fc6f02fdf04c req-7b3b279f-cb48-45a6-9728-bf64b547c352 tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1162.939091] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1162.939427] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.939572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.939639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.939862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.940068] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.940145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.940227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.940390] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.940486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.940578] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.278035] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-223 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.278510] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.278510] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.278699] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.279017] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.279182] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.279356] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.279613] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.279787] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.280179] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.280353] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.280503] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.280641] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.280785] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.280916] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.281091] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.310068] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.310434] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1163.310680] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.310937] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.311358] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-767857df-634e-4992-9b2a-d074fda2714a taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.311578] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-767857df-634e-4992-9b2a-d074fda2714a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.311738] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-767857df-634e-4992-9b2a-d074fda2714a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.312216] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-767857df-634e-4992-9b2a-d074fda2714a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.312410] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('767857df-634e-4992-9b2a-d074fda2714a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.443017] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.815500] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.815705] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.815827] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.816123] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.816283] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.816423] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 767857df-634e-4992-9b2a-d074fda2714a not found, creating... [ 1163.816677] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.816835] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.817030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.817185] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.817325] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.817599] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.817751] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.817865] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.818080] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.818217] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.818354] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 767857df-634e-4992-9b2a-d074fda2714a is going to be created. [ 1163.838626] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.838978] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.838978] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.839097] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.839323] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.839550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-767857df-634e-4992-9b2a-d074fda2714a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.944971] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.447575] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.447868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.447868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.447939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.448012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.448114] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1164.481786] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.481980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.481980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.482275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.482428] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.492693] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1164.527738] env[66730]: INFO networking_nsxv3.common.synchronization [req-9a150664-3f3d-4f3f-b13d-fc6f02fdf04c req-cd057c8f-e6e9-47ec-93df-ba0ac81f42d1 service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1164.527738] env[66730]: INFO networking_nsxv3.common.synchronization [req-9a150664-3f3d-4f3f-b13d-fc6f02fdf04c req-cd057c8f-e6e9-47ec-93df-ba0ac81f42d1 service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1164.527869] env[66730]: INFO networking_nsxv3.common.synchronization [req-9a150664-3f3d-4f3f-b13d-fc6f02fdf04c req-cd057c8f-e6e9-47ec-93df-ba0ac81f42d1 service nova] Enqueued Resource ID: 767857df-634e-4992-9b2a-d074fda2714a with Priority: HIGHEST for action port [ 1164.528403] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1164.528605] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1164.529092] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 767857df-634e-4992-9b2a-d074fda2714a with Priority: HIGHEST for action port [ 1164.529092] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.529092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.529668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.530531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.530531] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.531669] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.531937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.533073] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-767857df-634e-4992-9b2a-d074fda2714a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.533073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-767857df-634e-4992-9b2a-d074fda2714a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.533073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-767857df-634e-4992-9b2a-d074fda2714a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.533073] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-767857df-634e-4992-9b2a-d074fda2714a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.533073] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('767857df-634e-4992-9b2a-d074fda2714a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.815760] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 1164.815979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.816523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.816745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.816931] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.817052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.817118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.817273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.817348] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.817605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.817728] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.036340] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.036441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.036674] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 767857df-634e-4992-9b2a-d074fda2714a with status ACTIVE [ 1165.036914] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.036994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.037094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.037228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.037317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.037573] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.037645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.037645] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.038461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.038461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.038461] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.038461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.038461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.038461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.038461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.038461] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 767857df-634e-4992-9b2a-d074fda2714a is going to be updated. [ 1165.062285] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.062463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.062530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.062745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.062916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.063100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-767857df-634e-4992-9b2a-d074fda2714a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.319869] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.822285] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 395afc29-8cfd-45e2-9399-f1ce306e15d4: rpc.has_security_group_logging(os_id): False [ 1165.840480] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.840682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.840682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.840914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.841012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.841306] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.841419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.841493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.841648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.841724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.841813] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be updated. [ 1165.901576] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.901803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.901858] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.902069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.902278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.915670] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 1166.502806] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1166.503023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.503174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.503327] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.503524] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.503639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.503701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.503855] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.503935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.504038] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.006661] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.509209] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.933463] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 1167.933655] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.011477] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.011860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.011860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.011951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.011983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.012093] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1168.043390] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.043567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.043682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.044017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.044017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.057784] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1168.680646] env[66730]: INFO networking_nsxv3.common.synchronization [req-5345034f-d19e-4433-868c-a247cc9d5f1b req-be7827f6-6f44-4ad8-99f5-b4be085c6137 tempest-DeleteServersTestJSON-1353383505 tempest-DeleteServersTestJSON-1353383505-project-member] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1168.683689] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGHEST for action security_group_members [ 1168.683689] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.683689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.683689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.683689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.683689] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.683689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.683689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.683689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.683689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.683689] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.187064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.187064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.187064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.187064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.187064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.187553] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.187553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.187553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.187664] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.187725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.187812] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be updated. [ 1169.218847] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.218963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.219015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.219275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.219997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.229767] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: IN_PROGRESS for 2s [ 1170.069053] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1170.069053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.069247] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.069323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.069517] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.069635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.069699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.069851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.069932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.070032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.070140] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.573057] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.573057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.573057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.573057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.573057] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.573057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.573057] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.573634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.573634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.573634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.573634] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.573772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.573772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.573851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.573982] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.574088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.574147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.574282] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.574357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.574435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.574526] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.076856] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3e2980-ed0f-4c18-a149-cded1b258ec9: rpc.has_security_group_logging(os_id): False [ 1171.096536] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.096742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.096803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.097096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.097275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.097597] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.097771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.097886] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.098162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.098304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.098555] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.098686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.098755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.098930] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.099054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.099256] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.099352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.099414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.099560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.099635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.099752] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1171.164890] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.165523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.165642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.165896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.166066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.191564] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1171.249970] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 in Status: SUCCESS [ 1171.250206] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 deletion is rescheduled due to dependency. [ 1171.250365] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.209895] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1173.209895] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.404728] env[66730]: INFO networking_nsxv3.common.synchronization [req-658cd875-00b7-446f-80df-4a542f1927ae req-0c6fcd6f-ba5c-4857-b927-2877601dc7bb tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 1173.404728] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 1173.404728] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.404728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.404728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.404728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.404728] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.404728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.404728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.404728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.404728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.404728] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.906673] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.409145] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.912392] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.912736] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.912824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.913064] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.913178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.913258] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 is going to be updated. [ 1174.950514] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.950717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.950717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.951121] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.951975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.961277] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: IN_PROGRESS for 2s [ 1176.140513] env[66730]: INFO networking_nsxv3.common.synchronization [req-199dd5f6-d5a8-4b7e-8d06-18c2b7ed2fc4 req-73010202-d753-4b5a-a54f-944f6d93cf3a tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1176.140841] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1176.141785] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.141785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.141785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.141785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.141785] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.141785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.142066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.142170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.142280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.142451] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.645834] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.974379] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: SUCCESS [ 1176.974599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.148270] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.378408] env[66730]: INFO networking_nsxv3.common.synchronization [req-f2cea4af-7859-42e6-88dc-158276d003b8 req-2629031c-6049-48d7-82cd-0925047b60ef tempest-ServersTestManualDisk-901239740 tempest-ServersTestManualDisk-901239740-project-member] Enqueued Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_members [ 1177.378937] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd with Priority: HIGHEST for action security_group_members [ 1177.379263] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.379383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.379450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.379637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.379788] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.379884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.379945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.380174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.380252] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.380345] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c0b7262-514c-4f8f-99ae-f575f19b5ccd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.650908] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.651152] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.651152] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.651346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.651442] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.651541] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1177.683038] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.683231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.683231] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.683517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.683605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.693828] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1177.883454] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.883663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.883663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.883871] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.883958] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.884180] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.884277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.884341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.884491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.884567] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.884653] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd is going to be updated. [ 1177.911566] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.911768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.911886] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.912167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.912422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.921332] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd in Status: IN_PROGRESS for 2s [ 1179.704036] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1179.704036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.934108] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd in Status: SUCCESS [ 1179.934300] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c0b7262-514c-4f8f-99ae-f575f19b5ccd deletion is rescheduled due to dependency. [ 1179.934448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c0b7262-514c-4f8f-99ae-f575f19b5ccd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.379797] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1182.380171] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1186.435087] env[66730]: INFO networking_nsxv3.common.synchronization [req-97b6e1cc-21dc-470a-bdbd-3e3ab246ecc4 req-1400afee-6a40-4146-933a-65a4778ade3d tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1186.435665] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1186.435970] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.436295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.436375] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.436565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.436738] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.437191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.437191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.437191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.437191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.437377] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.775570] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-223 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.775781] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.775905] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.776215] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.776484] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.776646] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.776761] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.776975] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.777146] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.777357] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1186.777576] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.777851] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.777995] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.778138] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1186.778254] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.778393] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.799633] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.799809] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1186.799920] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.800167] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-223" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.800574] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-d7d2f598-a57f-403e-bfb7-d8d0b786006d taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.800754] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-d7d2f598-a57f-403e-bfb7-d8d0b786006d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.800874] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-d7d2f598-a57f-403e-bfb7-d8d0b786006d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.801222] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-d7d2f598-a57f-403e-bfb7-d8d0b786006d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.801387] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d2f598-a57f-403e-bfb7-d8d0b786006d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.939518] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.303680] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.303680] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.303934] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.304084] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.304234] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.304384] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port d7d2f598-a57f-403e-bfb7-d8d0b786006d not found, creating... [ 1187.304632] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.304801] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.304933] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.305161] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.305295] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.305571] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.305723] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.305836] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.306389] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.306586] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.306732] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: d7d2f598-a57f-403e-bfb7-d8d0b786006d is going to be created. [ 1187.330213] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.330503] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.330642] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.330927] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.331174] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.331399] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-d7d2f598-a57f-403e-bfb7-d8d0b786006d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.441764] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.944371] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.945863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.948094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.948094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.948094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.948094] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1187.987340] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.987529] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.987578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.987783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.987928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.998463] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1188.034328] env[66730]: INFO networking_nsxv3.common.synchronization [req-97b6e1cc-21dc-470a-bdbd-3e3ab246ecc4 req-154855fe-df70-4da3-8fe8-67a73617a86d service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1188.034447] env[66730]: INFO networking_nsxv3.common.synchronization [req-97b6e1cc-21dc-470a-bdbd-3e3ab246ecc4 req-154855fe-df70-4da3-8fe8-67a73617a86d service nova] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1188.034619] env[66730]: INFO networking_nsxv3.common.synchronization [req-97b6e1cc-21dc-470a-bdbd-3e3ab246ecc4 req-154855fe-df70-4da3-8fe8-67a73617a86d service nova] Enqueued Resource ID: d7d2f598-a57f-403e-bfb7-d8d0b786006d with Priority: HIGHEST for action port [ 1188.035201] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_rules [ 1188.035451] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1188.035559] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d2f598-a57f-403e-bfb7-d8d0b786006d with Priority: HIGHEST for action port [ 1188.035860] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.035956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.036034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.036235] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.036315] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.037181] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.037278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.037503] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7d2f598-a57f-403e-bfb7-d8d0b786006d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.037574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7d2f598-a57f-403e-bfb7-d8d0b786006d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.037617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7d2f598-a57f-403e-bfb7-d8d0b786006d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.037817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7d2f598-a57f-403e-bfb7-d8d0b786006d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.037893] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d2f598-a57f-403e-bfb7-d8d0b786006d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.539758] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.540059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.541171] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7d2f598-a57f-403e-bfb7-d8d0b786006d with status ACTIVE [ 1188.541577] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.541678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.541742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.541907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.542042] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.542547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.542547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.542547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.542956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.542956] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.542956] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.543133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.543133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.543207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.543295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.543361] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7d2f598-a57f-403e-bfb7-d8d0b786006d is going to be updated. [ 1188.567135] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.567349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.567398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.567611] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.567748] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.567938] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7d2f598-a57f-403e-bfb7-d8d0b786006d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.008831] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1190.009248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.009248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.009386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.009575] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.009692] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.009755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.009996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.009996] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.010124] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.511982] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.015135] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.517588] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.517778] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.517876] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.518204] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.518371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.518497] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1191.548167] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.548411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.548411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.548623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.548768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.559199] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1193.036772] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1193.036772] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1193.201378] env[66730]: INFO networking_nsxv3.common.synchronization [req-6e45380c-9f2f-437f-8329-458129c8033c req-ad15dbde-5632-4379-b2c6-55525feb5bae tempest-ServerActionsTestOtherA-923934559 tempest-ServerActionsTestOtherA-923934559-project-member] Enqueued Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 1193.201702] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 with Priority: HIGHEST for action security_group_members [ 1193.201974] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.202607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.202607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.202607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.202965] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.203052] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.203140] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.203875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.203875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.203875] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90b73cdb-a74a-4eb6-9916-f76b4b7a65f9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.573143] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1193.573143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.573143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.573456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.573616] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.573751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.573826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.574038] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.574154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.574250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.574345] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.706656] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.706877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.706877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.707019] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.707114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.707320] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.707423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.707485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.707654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.707762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.707872] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 is going to be updated. [ 1193.747699] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.748311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.748406] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.748707] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.748907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.762775] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: IN_PROGRESS for 2s [ 1194.076726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.077178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.077178] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.077486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.077712] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.077902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.077992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.078183] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.078277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.078368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.078533] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.078633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.078746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.078912] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.079108] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.079236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.079275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.079417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.079521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.079610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.079737] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.583086] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3e2980-ed0f-4c18-a149-cded1b258ec9: rpc.has_security_group_logging(os_id): False [ 1194.602019] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.602263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.602263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.602446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.602531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.602764] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.602874] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.602973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.603174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.603293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.603572] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.603714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.603819] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.604021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.604140] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.604371] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.604473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.604535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.604676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.604752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.604835] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1194.665480] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.665710] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.665764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.666025] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.666215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.679963] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1195.773156] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 in Status: SUCCESS [ 1195.773532] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b73cdb-a74a-4eb6-9916-f76b4b7a65f9 deletion is rescheduled due to dependency. [ 1195.773532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b73cdb-a74a-4eb6-9916-f76b4b7a65f9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.693044] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1196.693281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.202996] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1198.203283] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1201.425679] env[66730]: INFO networking_nsxv3.common.synchronization [req-9fd4ac32-f6b4-4e04-a60d-2fc9ee8de83f req-531b3510-11df-48dc-9043-a3c3118de1b5 tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1201.427539] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1201.428218] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.428218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.428218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.428218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.428218] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.428520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.428520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.428520] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.428622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.428700] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.479297] env[66730]: INFO networking_nsxv3.common.synchronization [None req-894eef32-bd60-422d-8b95-547b3022686d None None] Enqueued Resource ID: 9055ded0-cce3-48bf-8bdb-7c99526d8d4b with Priority: HIGHEST for action port [ 1201.479596] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9055ded0-cce3-48bf-8bdb-7c99526d8d4b with Priority: HIGHEST for action port [ 1201.479901] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-9055ded0-cce3-48bf-8bdb-7c99526d8d4b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.480035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9055ded0-cce3-48bf-8bdb-7c99526d8d4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.480105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9055ded0-cce3-48bf-8bdb-7c99526d8d4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.480446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9055ded0-cce3-48bf-8bdb-7c99526d8d4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.480446] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9055ded0-cce3-48bf-8bdb-7c99526d8d4b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.931698] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.982338] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9055ded0-cce3-48bf-8bdb-7c99526d8d4b [ 1201.982681] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.982855] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.982923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.983182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.983277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.983391] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9055ded0-cce3-48bf-8bdb-7c99526d8d4b already deleted. [ 1201.983476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9055ded0-cce3-48bf-8bdb-7c99526d8d4b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.435030] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.836694] env[66730]: INFO networking_nsxv3.common.synchronization [req-f9cd758c-827a-4e14-b1fc-e867acfa06a7 req-95379391-e0fa-4cc3-946b-7a559e083667 tempest-ServersTestJSON-1508465953 tempest-ServersTestJSON-1508465953-project-member] Enqueued Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_members [ 1202.837659] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGHEST for action security_group_members [ 1202.838107] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aa77707-f5c7-48ed-9703-9e099c01463b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.838279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.838400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.838741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.838996] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.839114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.839207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.841330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.841330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.841510] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.938615] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.938615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.938615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.938615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.938615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.938615] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1202.974525] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.974669] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.974741] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.974918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.975127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.985024] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1203.346263] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.346420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.346491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.346709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.346800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.346996] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.347124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.347177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.347369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.347448] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.347525] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aa77707-f5c7-48ed-9703-9e099c01463b is going to be updated. [ 1203.376026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.376026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.376026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.376026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.376026] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.385589] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aa77707-f5c7-48ed-9703-9e099c01463b in Status: IN_PROGRESS for 2s [ 1203.981918] env[66730]: INFO networking_nsxv3.common.synchronization [None req-b6c02779-3456-4a1b-9516-bb9e3612e07c None None] Enqueued Resource ID: d6ed9114-ce6c-49d1-9d4a-9d3a86fe2523 with Priority: HIGHEST for action port [ 1203.983099] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6ed9114-ce6c-49d1-9d4a-9d3a86fe2523 with Priority: HIGHEST for action port [ 1203.983307] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6ed9114-ce6c-49d1-9d4a-9d3a86fe2523 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.983576] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6ed9114-ce6c-49d1-9d4a-9d3a86fe2523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.983764] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6ed9114-ce6c-49d1-9d4a-9d3a86fe2523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.984185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6ed9114-ce6c-49d1-9d4a-9d3a86fe2523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.984372] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6ed9114-ce6c-49d1-9d4a-9d3a86fe2523',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.488567] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6ed9114-ce6c-49d1-9d4a-9d3a86fe2523 [ 1204.489015] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.489287] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.489399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.489633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.489724] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.489844] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6ed9114-ce6c-49d1-9d4a-9d3a86fe2523 already deleted. [ 1204.489935] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6ed9114-ce6c-49d1-9d4a-9d3a86fe2523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.996115] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1204.996425] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.397134] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aa77707-f5c7-48ed-9703-9e099c01463b in Status: SUCCESS [ 1205.397307] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aa77707-f5c7-48ed-9703-9e099c01463b deletion is rescheduled due to dependency. [ 1205.397419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.732456] env[66730]: INFO networking_nsxv3.common.synchronization [req-d5d1d691-d04f-49c8-add5-5fa7dd574981 req-81ed2e0a-46d4-48d1-ae0c-b8e273bdd2d0 tempest-ServersTestJSON-1934008573 tempest-ServersTestJSON-1934008573-project-member] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1207.733049] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGHEST for action security_group_members [ 1207.733388] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.733560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.733648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.733892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.734098] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.734230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.734314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.734485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.734728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.734728] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.238010] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.238211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.238291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.238522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.238613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.238817] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.238918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.238982] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.239189] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.239268] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.239356] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be updated. [ 1208.242043] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.242218] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.242332] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.242551] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.242832] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.243025] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.243105] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.243492] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.243492] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.243634] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.243743] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.243864] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.243918] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.244033] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.244139] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.244264] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.273237] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.273480] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1208.273673] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.273921] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-228" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.274376] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.274610] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.274781] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.275146] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.275316] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2bae48a-d631-400a-bcf8-8b310cb6e2ec',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.277489] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.277643] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.277743] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.277971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.278160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.289368] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: IN_PROGRESS for 2s [ 1208.780273] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.780732] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.780732] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.781019] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.781073] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.781401] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.781564] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.781707] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.781917] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.782056] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.782393] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.782598] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.782720] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.783070] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.783557] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.784515] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: f2bae48a-d631-400a-bcf8-8b310cb6e2ec is going to be updated. [ 1208.813854] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.814205] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.814366] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.814657] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.814862] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.815097] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.479164] env[66730]: INFO networking_nsxv3.common.synchronization [req-dc169b76-eb0b-43fc-9d87-cf1821ea490c req-b71dd73e-e1fa-46d6-a8c6-12e9888eb882 service nova] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 1209.479347] env[66730]: INFO networking_nsxv3.common.synchronization [req-dc169b76-eb0b-43fc-9d87-cf1821ea490c req-b71dd73e-e1fa-46d6-a8c6-12e9888eb882 service nova] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 1209.479481] env[66730]: INFO networking_nsxv3.common.synchronization [req-dc169b76-eb0b-43fc-9d87-cf1821ea490c req-b71dd73e-e1fa-46d6-a8c6-12e9888eb882 service nova] Enqueued Resource ID: f2bae48a-d631-400a-bcf8-8b310cb6e2ec with Priority: HIGHEST for action port [ 1209.479980] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_rules [ 1209.480127] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 1209.480279] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2bae48a-d631-400a-bcf8-8b310cb6e2ec with Priority: HIGHEST for action port [ 1209.480547] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.480671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.480746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.480929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.480995] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.481869] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.481983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.482058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.482225] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.482429] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.482523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.482584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.482726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.482863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.482986] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.483736] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.483954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.483954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.484066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.484120] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2bae48a-d631-400a-bcf8-8b310cb6e2ec',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.986502] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.986804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.986840] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.987746] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2bae48a-d631-400a-bcf8-8b310cb6e2ec with status ACTIVE [ 1209.988505] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.988505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.988505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.988505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.988505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.988761] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.988761] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.988855] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.988976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.989068] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.989254] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.989400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.989400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.989537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.989607] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.989687] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2bae48a-d631-400a-bcf8-8b310cb6e2ec is going to be updated. [ 1210.012018] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.012209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.012262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.012420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.012546] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.012696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2bae48a-d631-400a-bcf8-8b310cb6e2ec" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.299168] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 in Status: SUCCESS [ 1210.299323] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 deletion is rescheduled due to dependency. [ 1210.299429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.491826] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.942747] env[66730]: INFO networking_nsxv3.common.synchronization [req-a089547e-0750-4a9b-a985-9685fd1162bd req-efaa2ecb-1ba4-4de1-a512-cf73788c9360 tempest-ServerRescueNegativeTestJSON-2058866044 tempest-ServerRescueNegativeTestJSON-2058866044-project-member] Enqueued Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1210.943558] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1210.944588] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.944794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.944824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.945110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.945274] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.945378] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.945480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.945631] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.945733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.945805] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.994042] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.994421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.994421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.994533] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.994634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.994746] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 1211.026498] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.026620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.026663] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.026908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.027080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.040081] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 1211.338024] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-742 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.339036] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.339036] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.339036] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.339317] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.339511] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.339642] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.339918] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.340069] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.340292] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1211.340406] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1211.340515] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1211.340913] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1211.341065] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1211.341175] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1211.341366] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1211.361565] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1211.361747] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1211.361885] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1211.362079] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.362414] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-82c1b6de-f6bb-46b8-8c6d-2ac947918352 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.362589] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-82c1b6de-f6bb-46b8-8c6d-2ac947918352" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.362710] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-82c1b6de-f6bb-46b8-8c6d-2ac947918352" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.366130] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-82c1b6de-f6bb-46b8-8c6d-2ac947918352" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.366130] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c1b6de-f6bb-46b8-8c6d-2ac947918352',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.450619] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.450964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.450964] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.451215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.451275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.451436] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.451532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.451585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.451729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.451804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.451890] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fcf4123-cafd-4d32-a572-25448d38c499 already deleted. [ 1211.451972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.866258] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.866465] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.866547] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.866932] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.867118] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.867277] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 82c1b6de-f6bb-46b8-8c6d-2ac947918352 not found, creating... [ 1211.867533] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.867691] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.867813] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.868034] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.868173] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.868448] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.868602] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.868716] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.868919] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.869062] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.869199] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 82c1b6de-f6bb-46b8-8c6d-2ac947918352 is going to be created. [ 1211.890503] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.890742] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.890807] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.891080] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.891308] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.891548] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-82c1b6de-f6bb-46b8-8c6d-2ac947918352" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.608357] env[66730]: INFO networking_nsxv3.common.synchronization [req-a089547e-0750-4a9b-a985-9685fd1162bd req-cd253a7c-7d07-42cb-9e93-c5b1b10e0aab service nova] Enqueued Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_rules [ 1212.608357] env[66730]: INFO networking_nsxv3.common.synchronization [req-a089547e-0750-4a9b-a985-9685fd1162bd req-cd253a7c-7d07-42cb-9e93-c5b1b10e0aab service nova] Enqueued Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1212.608357] env[66730]: INFO networking_nsxv3.common.synchronization [req-a089547e-0750-4a9b-a985-9685fd1162bd req-cd253a7c-7d07-42cb-9e93-c5b1b10e0aab service nova] Enqueued Resource ID: 82c1b6de-f6bb-46b8-8c6d-2ac947918352 with Priority: HIGHEST for action port [ 1212.608891] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_rules [ 1212.608891] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1212.609016] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c1b6de-f6bb-46b8-8c6d-2ac947918352 with Priority: HIGHEST for action port [ 1212.609247] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.609407] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.609473] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.609733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.609814] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.611440] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.611574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.611643] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.611823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.612377] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.612377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.612377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.612377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.612702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.612702] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.613399] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-82c1b6de-f6bb-46b8-8c6d-2ac947918352 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.613552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82c1b6de-f6bb-46b8-8c6d-2ac947918352" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.613552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82c1b6de-f6bb-46b8-8c6d-2ac947918352" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.614340] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82c1b6de-f6bb-46b8-8c6d-2ac947918352" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.614340] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c1b6de-f6bb-46b8-8c6d-2ac947918352',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.050531] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 1213.050902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.051156] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.051397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.051602] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.051727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.051794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.051962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.052061] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.052177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.052241] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.116246] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.116385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.116557] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.117504] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82c1b6de-f6bb-46b8-8c6d-2ac947918352 with status ACTIVE [ 1213.118047] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.118047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.118047] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.118236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.118270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.118437] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.118527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.119079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.119079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.119079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.119209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.119258] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.119293] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.119444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.119557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.119641] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82c1b6de-f6bb-46b8-8c6d-2ac947918352 is going to be updated. [ 1213.140744] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.140970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.140970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.141268] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.141268] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.141395] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82c1b6de-f6bb-46b8-8c6d-2ac947918352" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.216189] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2460cab-0c46-4e4d-b715-2a460f482adb req-cb487fbe-a500-45ff-a146-a77232a48c16 tempest-ServerRescueNegativeTestJSON-2058866044 tempest-ServerRescueNegativeTestJSON-2058866044-project-member] Enqueued Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1213.216844] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1213.218113] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.218833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.555179] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.573638] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-742 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.573832] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.574018] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.574298] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.574555] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.574722] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.574840] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.575054] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.575194] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.575392] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1213.575498] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1213.575611] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1213.575716] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1213.575817] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1213.575914] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1213.576050] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1213.596504] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1213.596693] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1213.596831] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1213.597010] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.597354] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-999ed316-1b80-45a1-b992-94c309f5ae6e taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.597550] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-999ed316-1b80-45a1-b992-94c309f5ae6e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.597669] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-999ed316-1b80-45a1-b992-94c309f5ae6e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.598015] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-999ed316-1b80-45a1-b992-94c309f5ae6e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.598207] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('999ed316-1b80-45a1-b992-94c309f5ae6e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.621546] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.060506] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a55c2a9-6077-4f76-8e80-8d941329a6ba: rpc.has_security_group_logging(os_id): False [ 1214.079628] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.079868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.079945] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.080199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.080364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.080542] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.080644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.080697] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.080868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.080953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.081052] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 1214.100545] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.100808] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.100931] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.101238] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.101394] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.101566] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 999ed316-1b80-45a1-b992-94c309f5ae6e not found, creating... [ 1214.101808] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.102034] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.102176] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.102406] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.102544] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.102905] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.103207] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.103375] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.103635] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.103824] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.104040] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 999ed316-1b80-45a1-b992-94c309f5ae6e is going to be created. [ 1214.123609] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.123609] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.123609] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.123919] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.124129] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.124366] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-999ed316-1b80-45a1-b992-94c309f5ae6e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.125509] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.125509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.125509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.125680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.125711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.126325] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fcf4123-cafd-4d32-a572-25448d38c499 is going to be created. [ 1214.156949] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.157191] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.157296] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.157522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.157681] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.159870] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.160044] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.160084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.160653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.160653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.174218] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: UNINITIALIZED for 2s [ 1214.176239] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 1214.838256] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2460cab-0c46-4e4d-b715-2a460f482adb req-c742ad11-f6c0-46e3-8366-ebf1ecda8612 service nova] Enqueued Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_rules [ 1214.838652] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2460cab-0c46-4e4d-b715-2a460f482adb req-c742ad11-f6c0-46e3-8366-ebf1ecda8612 service nova] Enqueued Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1214.838652] env[66730]: INFO networking_nsxv3.common.synchronization [req-d2460cab-0c46-4e4d-b715-2a460f482adb req-c742ad11-f6c0-46e3-8366-ebf1ecda8612 service nova] Enqueued Resource ID: 999ed316-1b80-45a1-b992-94c309f5ae6e with Priority: HIGHEST for action port [ 1214.839094] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_rules [ 1214.839234] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1214.839330] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 999ed316-1b80-45a1-b992-94c309f5ae6e with Priority: HIGHEST for action port [ 1214.839602] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.839706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.839914] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.840037] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.840209] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-999ed316-1b80-45a1-b992-94c309f5ae6e taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.840311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-999ed316-1b80-45a1-b992-94c309f5ae6e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.840370] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-999ed316-1b80-45a1-b992-94c309f5ae6e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.840571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-999ed316-1b80-45a1-b992-94c309f5ae6e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.840654] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('999ed316-1b80-45a1-b992-94c309f5ae6e',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.343369] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 999ed316-1b80-45a1-b992-94c309f5ae6e with status ACTIVE [ 1215.343761] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.343933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.344034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.345333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.345333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.345333] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.345333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.345333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.345333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.345333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.345763] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.345763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.345763] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.345963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.346292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.346444] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 999ed316-1b80-45a1-b992-94c309f5ae6e is going to be updated. [ 1215.373726] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.374041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.374242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.374573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.374752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.374962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-999ed316-1b80-45a1-b992-94c309f5ae6e" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.187826] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: SUCCESS [ 1216.188166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.188312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.188539] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.188738] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.188851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.188947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.189203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.189288] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.189377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.189470] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.194340] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 1216.194408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.196217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.196217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.196217] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.196217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.196217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.196217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.196217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.196217] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.698530] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.699898] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.699898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.201516] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.705268] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.705555] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.705689] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.706092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.706177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.706363] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fcf4123-cafd-4d32-a572-25448d38c499 is going to be updated. [ 1217.735908] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.736517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.736517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.736517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.736688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.746479] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: IN_PROGRESS for 2s [ 1219.733637] env[66730]: INFO networking_nsxv3.common.synchronization [None req-1176b9e7-289b-4afb-b99d-8f31c2870c7e None None] Enqueued Resource ID: 7e08dcf4-b87f-420c-9d16-01dd0e14bc97 with Priority: HIGHEST for action port [ 1219.733637] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e08dcf4-b87f-420c-9d16-01dd0e14bc97 with Priority: HIGHEST for action port [ 1219.733637] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e08dcf4-b87f-420c-9d16-01dd0e14bc97 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.733637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e08dcf4-b87f-420c-9d16-01dd0e14bc97" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.733637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e08dcf4-b87f-420c-9d16-01dd0e14bc97" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.733637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e08dcf4-b87f-420c-9d16-01dd0e14bc97" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.733637] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e08dcf4-b87f-420c-9d16-01dd0e14bc97',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.762034] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: SUCCESS [ 1219.762260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.762774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.763144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.763445] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.763602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.763647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.764281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.764281] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.765814] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.235507] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e08dcf4-b87f-420c-9d16-01dd0e14bc97 [ 1220.235868] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.236090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.236213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.237947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.237947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.237947] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e08dcf4-b87f-420c-9d16-01dd0e14bc97 already deleted. [ 1220.237947] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e08dcf4-b87f-420c-9d16-01dd0e14bc97" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.268069] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.770598] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.273586] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.274424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.274424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.274424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.274424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.274424] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fcf4123-cafd-4d32-a572-25448d38c499 is going to be updated. [ 1221.307133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.307316] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.307359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.310109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.310109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.319599] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: IN_PROGRESS for 2s [ 1222.035593] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7ab729c4-80ee-4b35-aed6-b1047b80296d None None] Enqueued Resource ID: d66cb487-0aef-4905-85ed-c0dfbdef9fc2 with Priority: HIGHEST for action port [ 1222.036059] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d66cb487-0aef-4905-85ed-c0dfbdef9fc2 with Priority: HIGHEST for action port [ 1222.036367] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-d66cb487-0aef-4905-85ed-c0dfbdef9fc2 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.036485] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d66cb487-0aef-4905-85ed-c0dfbdef9fc2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.036550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d66cb487-0aef-4905-85ed-c0dfbdef9fc2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.036813] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d66cb487-0aef-4905-85ed-c0dfbdef9fc2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.036895] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d66cb487-0aef-4905-85ed-c0dfbdef9fc2',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.538871] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d66cb487-0aef-4905-85ed-c0dfbdef9fc2 [ 1222.539162] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.539307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.539376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.539619] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.539704] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.539802] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d66cb487-0aef-4905-85ed-c0dfbdef9fc2 already deleted. [ 1222.539883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d66cb487-0aef-4905-85ed-c0dfbdef9fc2" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.333797] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: SUCCESS [ 1223.334210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.334321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.334654] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.334792] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.334953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.335039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.335159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.335289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.335436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.335542] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.335662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.335737] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.335896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.336069] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.336187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.336258] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.336423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.336521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.336608] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.336729] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.840058] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fcf4123-cafd-4d32-a572-25448d38c499: rpc.has_security_group_logging(os_id): False [ 1223.858055] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.858277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.858277] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.858481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.858564] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.858744] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.858840] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.858902] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.859126] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.859237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.859427] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.859524] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.859585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.859727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.859799] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.859999] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.860113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.860187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.860328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.860402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.860486] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fcf4123-cafd-4d32-a572-25448d38c499 is going to be created. [ 1223.941855] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.942190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.942190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.942376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.942572] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.959541] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: IN_PROGRESS for 2s [ 1225.973598] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: SUCCESS [ 1225.973946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.973994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.974233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.974298] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.058031] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-a46511eb-b0dc-4a4d-9f25-ea79b253d003 tempest-ServersTestMultiNic-1862728566 tempest-ServersTestMultiNic-1862728566-project-member] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1226.058256] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1226.058622] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.058745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.059545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.059545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.059545] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.059545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.059545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.059545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.059848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.059848] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.368629] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-b7c8c98e-b667-4e76-8ccc-fbc180a98720 tempest-ServersTestMultiNic-1862728566 tempest-ServersTestMultiNic-1862728566-project-member] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1226.368629] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1226.368822] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.368923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.477472] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.477650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.477723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.477955] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.478874] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.478874] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.478874] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.478874] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.478874] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.478874] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.478874] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.562688] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.562688] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.562923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.562923] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.563032] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.563805] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.563805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.563805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.563805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.563805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.563805] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d already deleted. [ 1226.563805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.564136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.564136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.564266] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.564362] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.564422] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.564560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.564640] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.564732] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.656100] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-38aa7e3d-50f0-49b4-ab32-ff849cfc255c tempest-ServersTestMultiNic-1862728566 tempest-ServersTestMultiNic-1862728566-project-member] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1226.656984] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1226.657074] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.657195] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.949058] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.949323] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-856" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.949473] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-856" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.949846] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-856" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.950171] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.950348] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.950542] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.950824] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.950995] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.951730] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1226.951730] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.951730] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.951730] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.951942] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1226.951942] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.952075] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.973876] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.974309] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1226.974309] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.974491] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-856" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.974704] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-b527efcc-291c-4d03-bfc2-38cb5d95e076 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.974879] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-b527efcc-291c-4d03-bfc2-38cb5d95e076" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.974998] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-b527efcc-291c-4d03-bfc2-38cb5d95e076" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.975336] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-b527efcc-291c-4d03-bfc2-38cb5d95e076" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.975477] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b527efcc-291c-4d03-bfc2-38cb5d95e076',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.981048] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.981257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.981331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.981521] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.981679] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.981774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.981832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.981976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.982101] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.982189] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.982333] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.982426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.982483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.982605] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.982737] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.982821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.982875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.983049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.983129] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.983207] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.983295] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.069114] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.069114] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.069114] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d already deleted. [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.069114] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.069114] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.070112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.070112] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.070112] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.478146] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.478417] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.478475] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.478877] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.479087] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.479289] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port b527efcc-291c-4d03-bfc2-38cb5d95e076 not found, creating... [ 1227.479615] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.479812] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.479960] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.480274] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.480446] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.480770] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.480947] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.481105] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.481440] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.481822] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.482042] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: b527efcc-291c-4d03-bfc2-38cb5d95e076 is going to be created. [ 1227.485734] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fcf4123-cafd-4d32-a572-25448d38c499: rpc.has_security_group_logging(os_id): False [ 1227.503484] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.503694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.503694] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.503899] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.503995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.504243] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.504343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.504404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.504568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.504647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.504830] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.504932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.504972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.505125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.505200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.505395] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.505491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.505553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.505683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.505758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.505843] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fcf4123-cafd-4d32-a572-25448d38c499 is going to be updated. [ 1227.507705] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.507874] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.507991] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.508230] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.508439] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.508640] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-b527efcc-291c-4d03-bfc2-38cb5d95e076" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.571676] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.571676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.571676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.571676] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.572067] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.573109] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.573230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.573304] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.573496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.573578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.573769] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.573880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.573929] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.574109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.574200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.574288] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d already deleted. [ 1227.574366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.594899] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: IN_PROGRESS for 2s [ 1228.207572] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-08c62454-9389-4bd9-bac4-961ea6208be1 service nova] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_rules [ 1228.207872] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-08c62454-9389-4bd9-bac4-961ea6208be1 service nova] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1228.207910] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-08c62454-9389-4bd9-bac4-961ea6208be1 service nova] Enqueued Resource ID: b527efcc-291c-4d03-bfc2-38cb5d95e076 with Priority: HIGHEST for action port [ 1228.208472] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_rules [ 1228.208612] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1228.208712] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b527efcc-291c-4d03-bfc2-38cb5d95e076 with Priority: HIGHEST for action port [ 1228.208988] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.209125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.209193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.209453] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.209537] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.210597] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.210597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.210714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.210822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.210964] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.211088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.211148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.211295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.211379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.211468] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.214543] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b527efcc-291c-4d03-bfc2-38cb5d95e076 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.214543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b527efcc-291c-4d03-bfc2-38cb5d95e076" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.214666] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b527efcc-291c-4d03-bfc2-38cb5d95e076" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.214729] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b527efcc-291c-4d03-bfc2-38cb5d95e076" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.214897] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b527efcc-291c-4d03-bfc2-38cb5d95e076',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.336676] env[66730]: INFO networking_nsxv3.common.synchronization [req-cb764cf4-fb26-4e1f-896b-f78352068f11 req-21d33ed6-dadd-4b9b-a415-aaf362a0dd44 tempest-ServerActionsTestOtherB-1094684457 tempest-ServerActionsTestOtherB-1094684457-project-member] Enqueued Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 1228.337300] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba with Priority: HIGHEST for action security_group_members [ 1228.337573] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55c2a9-6077-4f76-8e80-8d941329a6ba taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.337690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.337767] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.337946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.338112] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.338209] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.338265] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.338412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.338495] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.338588] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55c2a9-6077-4f76-8e80-8d941329a6ba',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.716614] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.716842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.716931] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.717977] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b527efcc-291c-4d03-bfc2-38cb5d95e076 with status ACTIVE [ 1228.718133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.718216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.718262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.718452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.718620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.718787] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.718890] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.718953] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.719138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.719219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.719399] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.719492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.719552] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.719712] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.719797] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.719911] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b527efcc-291c-4d03-bfc2-38cb5d95e076 is going to be updated. [ 1228.741902] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.742125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.742125] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.742314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.742444] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.742603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b527efcc-291c-4d03-bfc2-38cb5d95e076" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.841250] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.841452] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.841592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.841932] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.842105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.842448] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.842628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.842746] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.843048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.843202] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.843367] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba is going to be updated. [ 1228.872627] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.872888] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.872981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.873357] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.873598] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.888144] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: IN_PROGRESS for 2s [ 1228.992076] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-399 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.992180] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-399" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.992339] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-399" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.992674] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-399" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.992942] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.993199] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.993301] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.993537] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.993681] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.993904] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.994056] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1228.994190] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1228.994305] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1228.994427] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.995091] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1228.995091] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1229.015622] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1229.016012] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1229.016193] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1229.016415] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-399" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.016780] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-77e2033a-4526-4ad6-b686-96462a97e2e4 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.016966] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-77e2033a-4526-4ad6-b686-96462a97e2e4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.017103] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-77e2033a-4526-4ad6-b686-96462a97e2e4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.017534] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-77e2033a-4526-4ad6-b686-96462a97e2e4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.017670] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e2033a-4526-4ad6-b686-96462a97e2e4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.222017] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.522708] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.523032] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.523227] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.523855] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.523855] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.524036] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 77e2033a-4526-4ad6-b686-96462a97e2e4 not found, creating... [ 1229.524299] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.524507] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.524688] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.524980] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.525185] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.525569] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.525842] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.526022] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.526300] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.526514] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.526732] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 77e2033a-4526-4ad6-b686-96462a97e2e4 is going to be created. [ 1229.549050] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.549299] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.549445] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.549745] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.550010] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.550289] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-77e2033a-4526-4ad6-b686-96462a97e2e4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.610684] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: SUCCESS [ 1229.610878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.724740] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.724997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.724997] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.725217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.725347] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.725461] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be created. [ 1229.754735] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.754987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.754987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.755196] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.755359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.766608] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: UNINITIALIZED for 2s [ 1230.262707] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-c3b65361-e8b2-4e31-8f1a-e9c46f6aa977 service nova] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_rules [ 1230.263157] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-c3b65361-e8b2-4e31-8f1a-e9c46f6aa977 service nova] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1230.263157] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-c3b65361-e8b2-4e31-8f1a-e9c46f6aa977 service nova] Enqueued Resource ID: 77e2033a-4526-4ad6-b686-96462a97e2e4 with Priority: HIGHEST for action port [ 1230.264218] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_rules [ 1230.264218] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1230.264218] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e2033a-4526-4ad6-b686-96462a97e2e4 with Priority: HIGHEST for action port [ 1230.264474] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.264573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.265107] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.265242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.265495] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-77e2033a-4526-4ad6-b686-96462a97e2e4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.267883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77e2033a-4526-4ad6-b686-96462a97e2e4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.267883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77e2033a-4526-4ad6-b686-96462a97e2e4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.267883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77e2033a-4526-4ad6-b686-96462a97e2e4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.267883] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e2033a-4526-4ad6-b686-96462a97e2e4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.769842] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77e2033a-4526-4ad6-b686-96462a97e2e4 with status ACTIVE [ 1230.770242] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.770242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.770242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.770540] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.770639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.770826] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.770971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.771075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.771253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.771333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.771523] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.771636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.771700] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.771860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.771936] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.772034] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77e2033a-4526-4ad6-b686-96462a97e2e4 is going to be updated. [ 1230.794432] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.794618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.794718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.795016] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.795219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.795431] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77e2033a-4526-4ad6-b686-96462a97e2e4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.899237] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba in Status: SUCCESS [ 1230.899447] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55c2a9-6077-4f76-8e80-8d941329a6ba deletion is rescheduled due to dependency. [ 1230.899518] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55c2a9-6077-4f76-8e80-8d941329a6ba" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.049087] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.049304] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-856" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.049425] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-856" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.049701] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-856" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.049957] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.050131] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.050245] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.050451] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.050591] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.050792] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1231.050899] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1231.051030] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1231.051162] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1231.051273] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1231.051375] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1231.051503] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1231.072055] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1231.072177] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1231.072311] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1231.072487] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-856" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.072806] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-b0c34838-70cf-48df-b1a3-1412a6a4b21b taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.072977] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-b0c34838-70cf-48df-b1a3-1412a6a4b21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.073137] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-b0c34838-70cf-48df-b1a3-1412a6a4b21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.073459] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-b0c34838-70cf-48df-b1a3-1412a6a4b21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.073600] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0c34838-70cf-48df-b1a3-1412a6a4b21b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.575878] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.576310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.576310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.576514] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.576662] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.576812] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port b0c34838-70cf-48df-b1a3-1412a6a4b21b not found, creating... [ 1231.577073] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.577228] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.577344] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.577554] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.577687] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.577959] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.578121] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.578239] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.578443] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.578572] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.578708] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: b0c34838-70cf-48df-b1a3-1412a6a4b21b is going to be created. [ 1231.604664] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.604873] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.605037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.605310] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.605579] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.605806] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-b0c34838-70cf-48df-b1a3-1412a6a4b21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.778380] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1231.778380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.778545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.778796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.778959] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.779185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.779185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.779343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.779424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.779474] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.779903] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.780660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.780738] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.780966] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.781106] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.781834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.781834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.781834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.781834] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.284041] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.284041] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.284041] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.325913] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-ade49eec-5882-4ccb-8477-e9b5ce650e74 service nova] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_rules [ 1232.325913] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-ade49eec-5882-4ccb-8477-e9b5ce650e74 service nova] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1232.325913] env[66730]: INFO networking_nsxv3.common.synchronization [req-09ae68ea-666e-4834-b166-76a48ccf376a req-ade49eec-5882-4ccb-8477-e9b5ce650e74 service nova] Enqueued Resource ID: b0c34838-70cf-48df-b1a3-1412a6a4b21b with Priority: HIGHEST for action port [ 1232.326381] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_rules [ 1232.326561] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1232.326668] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0c34838-70cf-48df-b1a3-1412a6a4b21b with Priority: HIGHEST for action port [ 1232.327535] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.327816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.327902] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.327975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.328781] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0c34838-70cf-48df-b1a3-1412a6a4b21b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.328781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0c34838-70cf-48df-b1a3-1412a6a4b21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.328781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0c34838-70cf-48df-b1a3-1412a6a4b21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.328781] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0c34838-70cf-48df-b1a3-1412a6a4b21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.328781] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0c34838-70cf-48df-b1a3-1412a6a4b21b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.786063] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.831066] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0c34838-70cf-48df-b1a3-1412a6a4b21b with status ACTIVE [ 1232.831296] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.831439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.831508] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.831722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.831812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.832039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.832115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.832173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.832323] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.832400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.832579] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.832713] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.832798] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.832859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.832931] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.833058] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0c34838-70cf-48df-b1a3-1412a6a4b21b is going to be updated. [ 1232.856186] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.856349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.856419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.856634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.856772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.856933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0c34838-70cf-48df-b1a3-1412a6a4b21b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.289632] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.289864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.289990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.290346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.290522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.290675] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1233.331720] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.331961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.331961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.332205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.332321] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.341915] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1235.353406] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1235.353696] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.353803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.354023] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.354217] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.354335] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.354402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.354553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.354634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.354718] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.354876] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.354954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.355034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.355167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.355334] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.355449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.355486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.355595] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.355665] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.355740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.355828] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.356680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.356847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.356992] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.357103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.357162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.357301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.357369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.357454] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.859458] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d: rpc.has_security_group_logging(os_id): False [ 1235.860750] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.903970] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.904155] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.904253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.904483] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.904571] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.904756] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.904855] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.904918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.905082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.905160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.906279] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.906279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.906279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.906279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.906279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.906279] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.906279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.906279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.906644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.906644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.906644] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be created. [ 1235.967554] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.967777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.967777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.967981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.968174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.979790] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1236.362970] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.865850] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.866020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.866090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.866350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.866481] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.866589] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1236.897784] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.897918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.897992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.898257] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.898404] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.907413] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1237.328162] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1237.328362] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1237.996819] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1237.997155] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.997346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.997525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.997617] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.501043] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.501990] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.918385] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1238.918757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.918946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.919194] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.919384] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.919498] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.919563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.919726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.919894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.919894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.920018] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.423077] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.423517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.423517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.423686] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.423921] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.424672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.424762] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.425013] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.425147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.425274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.425495] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.425624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.425711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.425920] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.426133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.426267] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.426359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.426550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.426658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.426772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.426898] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.930167] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d: rpc.has_security_group_logging(os_id): False [ 1239.949102] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.949102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.949352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.949400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.949575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.950242] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.950242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.950242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.950242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.950242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.950242] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.950496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.950496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.950551] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.950684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.950820] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.950918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.950970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.951237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.951237] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.951425] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1240.021604] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.021847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.021909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.022174] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.022338] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.035364] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1240.358173] env[66730]: INFO networking_nsxv3.common.synchronization [None req-961ee010-7e62-481d-bea0-0a7848e499e4 None None] Enqueued Resource ID: 91bdd306-9aaa-4171-a7b1-72c3821c1997 with Priority: HIGHEST for action port [ 1240.358960] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91bdd306-9aaa-4171-a7b1-72c3821c1997 with Priority: HIGHEST for action port [ 1240.360519] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-91bdd306-9aaa-4171-a7b1-72c3821c1997 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.361086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91bdd306-9aaa-4171-a7b1-72c3821c1997" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.363583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91bdd306-9aaa-4171-a7b1-72c3821c1997" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.363583] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91bdd306-9aaa-4171-a7b1-72c3821c1997" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.363583] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91bdd306-9aaa-4171-a7b1-72c3821c1997',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.869922] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91bdd306-9aaa-4171-a7b1-72c3821c1997 [ 1240.870282] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.870421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.870519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.870710] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.870800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.871043] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91bdd306-9aaa-4171-a7b1-72c3821c1997 already deleted. [ 1240.871043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91bdd306-9aaa-4171-a7b1-72c3821c1997" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.052805] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1242.053203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.053285] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.053506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.053594] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.433959] env[66730]: INFO networking_nsxv3.common.synchronization [None req-543cbf2d-390b-43cf-91ed-e22093d588bd None None] Enqueued Resource ID: de85c07e-b71c-4def-80e4-63108a67220a with Priority: HIGHEST for action port [ 1242.434227] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de85c07e-b71c-4def-80e4-63108a67220a with Priority: HIGHEST for action port [ 1242.434889] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-de85c07e-b71c-4def-80e4-63108a67220a taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.435099] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de85c07e-b71c-4def-80e4-63108a67220a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.435170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de85c07e-b71c-4def-80e4-63108a67220a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.435412] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de85c07e-b71c-4def-80e4-63108a67220a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.435494] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de85c07e-b71c-4def-80e4-63108a67220a',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.557917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.557917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.557917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.557917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.557917] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.557917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.557917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.558254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.558254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.558309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.558395] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.698626] env[66730]: INFO networking_nsxv3.common.synchronization [None req-7379623a-dcc2-4a9f-b5e8-7cddb0299d62 None None] Enqueued Resource ID: 478bb3a6-2ed1-4b83-b4f7-fc6ed04538a8 with Priority: HIGHEST for action port [ 1242.698877] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478bb3a6-2ed1-4b83-b4f7-fc6ed04538a8 with Priority: HIGHEST for action port [ 1242.699203] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-478bb3a6-2ed1-4b83-b4f7-fc6ed04538a8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.699342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-478bb3a6-2ed1-4b83-b4f7-fc6ed04538a8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.699402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-478bb3a6-2ed1-4b83-b4f7-fc6ed04538a8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.699638] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-478bb3a6-2ed1-4b83-b4f7-fc6ed04538a8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.699718] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('478bb3a6-2ed1-4b83-b4f7-fc6ed04538a8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.938126] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de85c07e-b71c-4def-80e4-63108a67220a [ 1242.938383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.938589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.938650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.938926] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.939118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.939206] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de85c07e-b71c-4def-80e4-63108a67220a already deleted. [ 1242.939307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de85c07e-b71c-4def-80e4-63108a67220a" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.060821] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.060821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.061248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.061248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.061417] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.061547] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.061610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.061785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.061885] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.061978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.062140] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.062232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.062384] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.062531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.062585] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.062653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.062703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.062842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.062919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.062980] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.063092] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.202127] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 478bb3a6-2ed1-4b83-b4f7-fc6ed04538a8 [ 1243.202234] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.202463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.202565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.203088] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.203723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.203723] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:478bb3a6-2ed1-4b83-b4f7-fc6ed04538a8 already deleted. [ 1243.203723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-478bb3a6-2ed1-4b83-b4f7-fc6ed04538a8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.443627] env[66730]: INFO networking_nsxv3.common.synchronization [req-fac29941-17a9-4e5d-998b-b97773ef27f5 req-35ee60e3-0424-4baf-8229-ea4b7aee9cea tempest-ServersTestMultiNic-1862728566 tempest-ServersTestMultiNic-1862728566-project-member] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1243.444325] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1243.445069] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.445069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.445069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.445069] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.445069] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.445318] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.445318] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.445380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.445423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.445575] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.565384] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d: rpc.has_security_group_logging(os_id): False [ 1243.585667] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.585844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.585915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.586171] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.586267] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.586459] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.586556] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.586621] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.586768] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.586844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.587046] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.587143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.587205] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.587345] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.587420] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.587678] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.587774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.587835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.587975] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.588059] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.588143] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1243.649043] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.649043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.649043] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.649242] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.649538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.677474] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1243.690393] env[66730]: INFO networking_nsxv3.common.synchronization [req-fac29941-17a9-4e5d-998b-b97773ef27f5 req-d6a85580-03de-4a9e-9909-de44f3ee44bb tempest-ServersTestMultiNic-1862728566 tempest-ServersTestMultiNic-1862728566-project-member] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1243.690949] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1243.691327] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.691433] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.949364] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.982285] env[66730]: INFO networking_nsxv3.common.synchronization [req-fac29941-17a9-4e5d-998b-b97773ef27f5 req-d86c03af-1479-4aba-8b2a-dc71864a5363 tempest-ServersTestMultiNic-1862728566 tempest-ServersTestMultiNic-1862728566-project-member] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1243.982285] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1243.982590] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.982709] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.452232] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.955563] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.955783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.955783] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.956145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.956145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.956410] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1244.986716] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.986716] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.986716] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.986985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.987190] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.998641] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1245.119758] env[66730]: INFO networking_nsxv3.common.synchronization [None req-75923567-95c2-4b16-a23f-9ad77113c738 None None] Enqueued Resource ID: 63fd2e54-0204-4591-b3d4-468fad8d16a8 with Priority: HIGHEST for action port [ 1245.120280] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63fd2e54-0204-4591-b3d4-468fad8d16a8 with Priority: HIGHEST for action port [ 1245.120585] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-63fd2e54-0204-4591-b3d4-468fad8d16a8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.120712] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63fd2e54-0204-4591-b3d4-468fad8d16a8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.120779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63fd2e54-0204-4591-b3d4-468fad8d16a8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.121124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63fd2e54-0204-4591-b3d4-468fad8d16a8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.121257] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63fd2e54-0204-4591-b3d4-468fad8d16a8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.624140] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63fd2e54-0204-4591-b3d4-468fad8d16a8 [ 1245.624541] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.624641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.624687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.624963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.625081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.625184] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63fd2e54-0204-4591-b3d4-468fad8d16a8 already deleted. [ 1245.625269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63fd2e54-0204-4591-b3d4-468fad8d16a8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.692499] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1245.692725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.851022] env[66730]: INFO networking_nsxv3.common.synchronization [req-7b75e1d1-e05e-47af-ada8-bf0f6f6b7d22 req-9d0dd138-c00f-4509-ba52-1dcfddf11717 tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1246.851599] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1246.851911] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.852036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.852098] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.852295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.852448] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.852542] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.852603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.852751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.852849] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.852942] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.008765] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1247.008937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.009563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.009563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.009563] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.009563] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.009777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.009777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.009838] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.010408] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.355199] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.355429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.355429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.355682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.355775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.355976] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.356108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.356165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.356290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.356366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.356451] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be updated. [ 1247.384773] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.384994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.385120] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.385369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.385575] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.394882] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 1247.515554] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.515740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.515793] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.516058] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.516166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.516374] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.516484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.516537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.516682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.516756] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.516842] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1247.542026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.542208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.542271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.542553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.542591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.552360] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1247.891325] env[66730]: INFO networking_nsxv3.common.synchronization [req-ff6f573e-4616-49f3-a5e5-f4f51cd10d52 req-ed8ca951-8df4-4371-9726-0a17fcd64b66 tempest-ServersNegativeTestMultiTenantJSON-783710947 tempest-ServersNegativeTestMultiTenantJSON-783710947-project-member] Enqueued Resource ID: d6d7c434-b719-4158-8390-2ca325980098 with Priority: HIGHEST for action security_group_members [ 1247.891820] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d7c434-b719-4158-8390-2ca325980098 with Priority: HIGHEST for action security_group_members [ 1247.892133] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d7c434-b719-4158-8390-2ca325980098 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.892254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.892318] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.892565] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.892722] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.892817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.892919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.893031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.893118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.893309] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d7c434-b719-4158-8390-2ca325980098',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.176402] env[66730]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1248.176618] env[66730]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-de0b7ea9-1d79-43d4-9983-f82adc6c12e5 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1248.222528] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.222733] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-347" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.222855] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-347" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.223234] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-347" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.223521] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.223678] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.223794] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.224024] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.224167] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.224377] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1248.224491] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1248.224599] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1248.224704] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1248.224811] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1248.224914] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1248.225061] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1248.247068] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1248.247253] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1248.247363] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1248.247538] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-347" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.247922] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-1876149a-4abe-4f19-80be-8fd218453512 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.248044] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-1876149a-4abe-4f19-80be-8fd218453512" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.248151] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-1876149a-4abe-4f19-80be-8fd218453512" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.248472] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-1876149a-4abe-4f19-80be-8fd218453512" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.248616] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1876149a-4abe-4f19-80be-8fd218453512',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.394947] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.395175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.395175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.395339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.395424] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.395643] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.395751] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.395812] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.395963] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.396049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.396131] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d7c434-b719-4158-8390-2ca325980098 already deleted. [ 1248.396210] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.750566] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.750804] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.750928] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.751283] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.751445] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.751602] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 1876149a-4abe-4f19-80be-8fd218453512 not found, creating... [ 1248.751863] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.752030] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.752150] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.752376] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.752512] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.752788] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.752940] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.753181] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.753281] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.753429] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.753569] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 1876149a-4abe-4f19-80be-8fd218453512 is going to be created. [ 1248.773717] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.773914] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.774049] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.774366] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.774603] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.774825] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-1876149a-4abe-4f19-80be-8fd218453512" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.319736] env[66730]: INFO networking_nsxv3.common.synchronization [None req-78c9e220-2624-4a3a-aa5c-a33d7d652ebf tempest-ServerRescueNegativeTestJSON-2058866044 tempest-ServerRescueNegativeTestJSON-2058866044-project-member] Enqueued Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_rules [ 1249.320671] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_rules [ 1249.320671] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a8e627c-dab5-44b7-8384-0678de165afe taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.320826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.320826] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.321157] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.321267] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.399708] env[66730]: INFO networking_nsxv3.common.synchronization [None req-2b4999f1-5042-4df7-a7dc-182ecbcf5571 tempest-ServerRescueNegativeTestJSON-2058866044 tempest-ServerRescueNegativeTestJSON-2058866044-project-member] Enqueued Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_rules [ 1249.399797] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_rules [ 1249.400587] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a8e627c-dab5-44b7-8384-0678de165afe taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.400714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.409018] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 1249.411230] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 deletion is rescheduled due to dependency. [ 1249.411230] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.490192] env[66730]: INFO networking_nsxv3.common.synchronization [req-ff6f573e-4616-49f3-a5e5-f4f51cd10d52 req-7ef2b785-acab-4969-90c5-ee931bef50fc service nova] Enqueued Resource ID: d6d7c434-b719-4158-8390-2ca325980098 with Priority: HIGHEST for action security_group_rules [ 1249.490192] env[66730]: INFO networking_nsxv3.common.synchronization [req-ff6f573e-4616-49f3-a5e5-f4f51cd10d52 req-7ef2b785-acab-4969-90c5-ee931bef50fc service nova] Enqueued Resource ID: d6d7c434-b719-4158-8390-2ca325980098 with Priority: HIGHEST for action security_group_members [ 1249.490192] env[66730]: INFO networking_nsxv3.common.synchronization [req-ff6f573e-4616-49f3-a5e5-f4f51cd10d52 req-7ef2b785-acab-4969-90c5-ee931bef50fc service nova] Enqueued Resource ID: 1876149a-4abe-4f19-80be-8fd218453512 with Priority: HIGHEST for action port [ 1249.490192] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d7c434-b719-4158-8390-2ca325980098 with Priority: HIGHEST for action security_group_rules [ 1249.490192] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d7c434-b719-4158-8390-2ca325980098 with Priority: HIGHEST for action security_group_members [ 1249.490192] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1876149a-4abe-4f19-80be-8fd218453512 with Priority: HIGHEST for action port [ 1249.490617] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6d7c434-b719-4158-8390-2ca325980098 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.490722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.490766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.492364] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.492364] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6d7c434-b719-4158-8390-2ca325980098',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.492606] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d7c434-b719-4158-8390-2ca325980098 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.492606] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.492722] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.492911] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.494436] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.494436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.494436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.494436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.494436] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.494436] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d7c434-b719-4158-8390-2ca325980098',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.495092] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-1876149a-4abe-4f19-80be-8fd218453512 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.495386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1876149a-4abe-4f19-80be-8fd218453512" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.495946] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1876149a-4abe-4f19-80be-8fd218453512" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.496513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1876149a-4abe-4f19-80be-8fd218453512" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.496599] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1876149a-4abe-4f19-80be-8fd218453512',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.562146] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1249.562413] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d deletion is rescheduled due to dependency. [ 1249.562537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.563113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.563641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.563715] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.563821] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.563885] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.564168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.564290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.564542] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.842659] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.842934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.842934] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.843215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.843349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.843440] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a8e627c-dab5-44b7-8384-0678de165afe already deleted. [ 1249.843526] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.843749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.843848] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.843931] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.992898] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d7c434-b719-4158-8390-2ca325980098 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.993075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.999197] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1876149a-4abe-4f19-80be-8fd218453512 with status ACTIVE [ 1249.999411] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.999597] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.999653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.999896] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.999992] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.000219] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.000328] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.000476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.000568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.000643] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.000854] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.000944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.001149] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.001280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.001320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.001556] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1876149a-4abe-4f19-80be-8fd218453512 is going to be updated. [ 1250.002620] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6d7c434-b719-4158-8390-2ca325980098',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.030509] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.030509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.030509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.030720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.030846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.031029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1876149a-4abe-4f19-80be-8fd218453512" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.066619] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.066755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.066834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.067022] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.067111] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.067302] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.067399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.067467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.067612] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.067687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.067772] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1250.098744] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.098972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.098972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.099168] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.099307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.108275] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1250.367039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.367373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.367373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.367492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.367534] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.367617] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a8e627c-dab5-44b7-8384-0678de165afe already deleted. [ 1250.367691] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.505139] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6d7c434-b719-4158-8390-2ca325980098',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.008110] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.008110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.008110] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.008376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.008441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.008547] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d7c434-b719-4158-8390-2ca325980098 is going to be created. [ 1251.035438] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.035672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.035672] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.035857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.036015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.046714] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d7c434-b719-4158-8390-2ca325980098 in Status: UNINITIALIZED for 2s [ 1252.119723] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1252.120055] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d deletion is rescheduled due to dependency. [ 1252.120120] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.058813] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d7c434-b719-4158-8390-2ca325980098 in Status: SUCCESS [ 1253.059046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.059219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.059480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.059686] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.059817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.059875] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.060189] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.060189] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.060295] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.060295] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6d7c434-b719-4158-8390-2ca325980098',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.562689] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d7c434-b719-4158-8390-2ca325980098 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.563090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.563090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.563187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.563405] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.563606] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.563606] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.563731] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.563785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.563869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.564026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d7c434-b719-4158-8390-2ca325980098 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.564122] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.564184] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.564315] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.564449] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.564528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.564591] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.564727] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.564796] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.564877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.564963] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6d7c434-b719-4158-8390-2ca325980098',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.983363] env[66730]: INFO networking_nsxv3.common.synchronization [req-f61c28fc-291c-47cb-a404-903ed263f983 req-3ae7ff05-7136-409e-bd8e-4a062157f677 tempest-AttachVolumeTestJSON-1280077890 tempest-AttachVolumeTestJSON-1280077890-project-member] Enqueued Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_members [ 1253.984360] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b245b6-5e49-420c-897d-4126cd8e7330 with Priority: HIGHEST for action security_group_members [ 1253.984942] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-90b245b6-5e49-420c-897d-4126cd8e7330 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.985159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.985270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.985615] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.985897] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.986105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.986228] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.986499] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.986610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.986711] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90b245b6-5e49-420c-897d-4126cd8e7330',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.067640] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6d7c434-b719-4158-8390-2ca325980098: rpc.has_security_group_logging(os_id): False [ 1254.086510] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.086714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.086714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.086937] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.087035] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.087320] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.087440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.087440] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.087600] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.087658] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.087821] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.087913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.087973] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.088124] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.088197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.088371] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.088464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.088525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.088662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.088734] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.088817] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6d7c434-b719-4158-8390-2ca325980098 is going to be created. [ 1254.163143] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.163416] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.163592] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.164063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.164180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.178623] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6d7c434-b719-4158-8390-2ca325980098 in Status: IN_PROGRESS for 2s [ 1254.489927] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.490138] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.490368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.490794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.490948] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.491338] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.491522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.491742] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.492012] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.492117] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.492227] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b245b6-5e49-420c-897d-4126cd8e7330 is going to be updated. [ 1254.527846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.528055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.528102] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.528371] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.528560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.541322] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b245b6-5e49-420c-897d-4126cd8e7330 in Status: IN_PROGRESS for 2s [ 1254.925152] env[66730]: INFO networking_nsxv3.common.synchronization [req-fd22e56a-3a04-44a4-b013-a3023f4df3f7 req-ad620936-3de9-43e1-9fcc-9f321e97627f tempest-ServerRescueNegativeTestJSON-2058866044 tempest-ServerRescueNegativeTestJSON-2058866044-project-member] Enqueued Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_members [ 1254.925782] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_members [ 1254.926031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a8e627c-dab5-44b7-8384-0678de165afe taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.926150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.926214] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.926494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.926659] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.926802] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.926844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.927170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.927170] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.927170] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.252608] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-742 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.252840] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.252961] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.253260] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.253559] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.253718] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.253833] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.254052] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.254193] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.254400] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.254510] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1255.254617] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1255.254721] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1255.254826] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.254927] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1255.255069] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1255.273214] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1255.273403] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1255.273564] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1255.273737] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-742" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.274065] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-3b794974-d156-49bf-ab5b-6505db4dddfe taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.274240] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-3b794974-d156-49bf-ab5b-6505db4dddfe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.274375] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-3b794974-d156-49bf-ab5b-6505db4dddfe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.274710] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-3b794974-d156-49bf-ab5b-6505db4dddfe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.274931] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b794974-d156-49bf-ab5b-6505db4dddfe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.431899] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.432081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.432130] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.432369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.432500] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.433094] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.433094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.433094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.433094] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.433380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.433380] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a8e627c-dab5-44b7-8384-0678de165afe already deleted. [ 1255.433457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.777739] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.777917] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.778029] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.778308] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.778462] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.778639] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 3b794974-d156-49bf-ab5b-6505db4dddfe not found, creating... [ 1255.778895] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.779070] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.779188] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.779413] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.779548] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.779823] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.780387] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.780387] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.780387] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.780481] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.780618] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 3b794974-d156-49bf-ab5b-6505db4dddfe is going to be created. [ 1255.802223] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.802474] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.802574] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.802847] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.803081] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.803365] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-3b794974-d156-49bf-ab5b-6505db4dddfe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.193491] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6d7c434-b719-4158-8390-2ca325980098 in Status: SUCCESS [ 1256.193832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.510118] env[66730]: INFO networking_nsxv3.common.synchronization [req-fd22e56a-3a04-44a4-b013-a3023f4df3f7 req-87a94e29-2178-4613-80e9-d1f6f4b4ddbf service nova] Enqueued Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_rules [ 1256.510323] env[66730]: INFO networking_nsxv3.common.synchronization [req-fd22e56a-3a04-44a4-b013-a3023f4df3f7 req-87a94e29-2178-4613-80e9-d1f6f4b4ddbf service nova] Enqueued Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_members [ 1256.510481] env[66730]: INFO networking_nsxv3.common.synchronization [req-fd22e56a-3a04-44a4-b013-a3023f4df3f7 req-87a94e29-2178-4613-80e9-d1f6f4b4ddbf service nova] Enqueued Resource ID: 3b794974-d156-49bf-ab5b-6505db4dddfe with Priority: HIGHEST for action port [ 1256.511597] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_rules [ 1256.511796] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_members [ 1256.511936] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b794974-d156-49bf-ab5b-6505db4dddfe with Priority: HIGHEST for action port [ 1256.512279] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a8e627c-dab5-44b7-8384-0678de165afe taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.512446] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.512573] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.512803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.512917] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.514026] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a8e627c-dab5-44b7-8384-0678de165afe taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.514200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.514346] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.514584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.514780] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.514940] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.515072] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.515507] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.515714] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.515998] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.517138] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b794974-d156-49bf-ab5b-6505db4dddfe taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.517290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b794974-d156-49bf-ab5b-6505db4dddfe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.517414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b794974-d156-49bf-ab5b-6505db4dddfe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.517667] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b794974-d156-49bf-ab5b-6505db4dddfe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.517784] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b794974-d156-49bf-ab5b-6505db4dddfe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.554371] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90b245b6-5e49-420c-897d-4126cd8e7330 in Status: SUCCESS [ 1256.554646] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90b245b6-5e49-420c-897d-4126cd8e7330 deletion is rescheduled due to dependency. [ 1256.554794] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90b245b6-5e49-420c-897d-4126cd8e7330" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.020045] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.021677] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a8e627c-dab5-44b7-8384-0678de165afe taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.021816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.022202] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b794974-d156-49bf-ab5b-6505db4dddfe with status ACTIVE [ 1257.022457] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.022517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.022550] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.022820] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.022870] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.023035] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.023135] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.023222] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.023408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.023512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.023676] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.023769] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.023824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.023965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.024055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.024152] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b794974-d156-49bf-ab5b-6505db4dddfe is going to be updated. [ 1257.048307] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.048455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.048512] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.048728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.048856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.049024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b794974-d156-49bf-ab5b-6505db4dddfe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.180488] env[66730]: INFO networking_nsxv3.common.synchronization [req-9ca7959a-9b49-4af9-baf9-ca8ecb2d773c req-3c5074d8-b64f-4fe2-8785-15ad9c4e05de tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1257.181172] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1257.181545] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.181652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.181720] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.181914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.182094] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.182197] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.182259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.182432] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.182548] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.182687] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.488037] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.488037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.488037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.488037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.488037] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.488037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.488037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.488541] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.488679] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.488861] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1257.488978] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1257.489135] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1257.489249] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1257.489361] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1257.489469] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1257.489598] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1257.508193] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1257.508358] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1257.508484] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1257.508652] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-523" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.508960] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-931377ff-8249-4f8b-9b0d-1cfac678746c taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.509145] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-931377ff-8249-4f8b-9b0d-1cfac678746c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.509265] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-931377ff-8249-4f8b-9b0d-1cfac678746c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.509612] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-931377ff-8249-4f8b-9b0d-1cfac678746c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.509780] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('931377ff-8249-4f8b-9b0d-1cfac678746c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.523462] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.686538] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.686538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.686538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.686538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.686538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.686894] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.686894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.686894] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.687075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.687456] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.687582] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be updated. [ 1257.715159] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.715487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.715584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.715745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.715884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.725384] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 1258.012675] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.013018] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.013249] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.013676] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.013944] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.014224] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 931377ff-8249-4f8b-9b0d-1cfac678746c not found, creating... [ 1258.015037] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.015037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.015037] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.015241] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.015327] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.016434] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.016434] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.016434] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.016434] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.016434] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.016434] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 931377ff-8249-4f8b-9b0d-1cfac678746c is going to be created. [ 1258.026328] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.026857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.026857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.026857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.026857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.027223] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a8e627c-dab5-44b7-8384-0678de165afe is going to be created. [ 1258.042162] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.042413] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.042575] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.042821] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.043070] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.043887] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-931377ff-8249-4f8b-9b0d-1cfac678746c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.054334] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.054334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.054334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.054586] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.054622] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.066702] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a8e627c-dab5-44b7-8384-0678de165afe in Status: UNINITIALIZED for 2s [ 1258.730601] env[66730]: INFO networking_nsxv3.common.synchronization [req-9ca7959a-9b49-4af9-baf9-ca8ecb2d773c req-6015d467-a267-4460-b468-e121ebf26d92 service nova] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_rules [ 1258.730923] env[66730]: INFO networking_nsxv3.common.synchronization [req-9ca7959a-9b49-4af9-baf9-ca8ecb2d773c req-6015d467-a267-4460-b468-e121ebf26d92 service nova] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1258.730923] env[66730]: INFO networking_nsxv3.common.synchronization [req-9ca7959a-9b49-4af9-baf9-ca8ecb2d773c req-6015d467-a267-4460-b468-e121ebf26d92 service nova] Enqueued Resource ID: 931377ff-8249-4f8b-9b0d-1cfac678746c with Priority: HIGHEST for action port [ 1258.731637] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_rules [ 1258.731773] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1258.731868] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 931377ff-8249-4f8b-9b0d-1cfac678746c with Priority: HIGHEST for action port [ 1258.732164] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.732290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.732398] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.732653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.732653] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.734074] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.734177] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.734430] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-931377ff-8249-4f8b-9b0d-1cfac678746c taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.734606] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-931377ff-8249-4f8b-9b0d-1cfac678746c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.734687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-931377ff-8249-4f8b-9b0d-1cfac678746c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.734873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-931377ff-8249-4f8b-9b0d-1cfac678746c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.734953] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('931377ff-8249-4f8b-9b0d-1cfac678746c',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.240814] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.240987] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.241262] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 931377ff-8249-4f8b-9b0d-1cfac678746c with status ACTIVE [ 1259.241499] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.241660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.241733] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.241961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.242127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.242234] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.242389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.242450] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.242635] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.242710] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.242922] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.243568] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.243780] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.244010] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.244173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.244299] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 931377ff-8249-4f8b-9b0d-1cfac678746c is going to be updated. [ 1259.269662] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.269662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.269662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.269662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.269662] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.269999] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-931377ff-8249-4f8b-9b0d-1cfac678746c" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.345105] env[66730]: INFO networking_nsxv3.common.synchronization [req-16912ac5-40b4-425f-96d2-fbfb3a0bc462 req-c3c1d177-89b6-461b-8125-2101d415009d tempest-ServersTestMultiNic-1862728566 tempest-ServersTestMultiNic-1862728566-project-member] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1259.345701] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1259.346528] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.346528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.346528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.346528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.346877] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.346877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.346877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.347313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.347313] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.347313] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.643848] env[66730]: INFO networking_nsxv3.common.synchronization [req-16912ac5-40b4-425f-96d2-fbfb3a0bc462 req-e1293391-85a9-4a64-8224-9b045145b4e3 tempest-ServersTestMultiNic-1862728566 tempest-ServersTestMultiNic-1862728566-project-member] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1259.644466] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1259.644832] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.644961] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.735056] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 1259.735334] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 deletion is rescheduled due to dependency. [ 1259.735369] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.735518] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.735771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.735960] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.736085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.736152] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.736314] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.736396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.736554] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.849584] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.849823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.849823] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.850066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.850175] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.850385] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.850491] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.850558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.850721] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.850792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.850880] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1259.880995] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.880995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.880995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.881516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.882113] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.891130] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1260.017488] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.017780] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-403" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.017895] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-403" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.018217] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-403" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.018569] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.018672] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.018785] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.019217] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.019398] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.019613] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1260.019751] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1260.019877] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1260.019987] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1260.020119] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1260.020251] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1260.020414] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1260.038560] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1260.038845] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1260.038909] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1260.039071] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-403" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.039395] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-fa2e0390-c04b-440d-af52-48e99819b4d8 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.039569] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-fa2e0390-c04b-440d-af52-48e99819b4d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.039688] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-fa2e0390-c04b-440d-af52-48e99819b4d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.040779] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-fa2e0390-c04b-440d-af52-48e99819b4d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.040779] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa2e0390-c04b-440d-af52-48e99819b4d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.079055] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a8e627c-dab5-44b7-8384-0678de165afe in Status: SUCCESS [ 1260.079180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.079869] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.079970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.080225] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.080376] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.080435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.080636] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.080758] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.080979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.081064] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.239326] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.542480] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.542743] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.542879] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.543268] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.543570] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.543773] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port fa2e0390-c04b-440d-af52-48e99819b4d8 not found, creating... [ 1260.544069] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.544246] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.544376] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.544640] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.544806] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.545142] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.545304] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.545454] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.545685] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.545819] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.545960] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: fa2e0390-c04b-440d-af52-48e99819b4d8 is going to be created. [ 1260.566639] env[66730]: INFO networking_nsxv3.common.synchronization [req-b38806a4-474b-4716-87c2-fa7170e534e9 req-b838a656-686b-48df-968e-205a0a94ece9 tempest-ServersNegativeTestMultiTenantJSON-783710947 tempest-ServersNegativeTestMultiTenantJSON-783710947-project-member] Enqueued Resource ID: d6d7c434-b719-4158-8390-2ca325980098 with Priority: HIGHEST for action security_group_members [ 1260.568015] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.568015] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.568522] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.569324] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.569324] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.569324] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-fa2e0390-c04b-440d-af52-48e99819b4d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.570680] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d7c434-b719-4158-8390-2ca325980098 with Priority: HIGHEST for action security_group_members [ 1260.570766] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d7c434-b719-4158-8390-2ca325980098 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.570893] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.571015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.571216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.571444] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.571596] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.571701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.571884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.572015] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.572168] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d7c434-b719-4158-8390-2ca325980098',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.583088] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.742369] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.075157] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.075538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.075538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.075749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.075868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.076126] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.076223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.076262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.076419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.076497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.076583] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d7c434-b719-4158-8390-2ca325980098 is going to be updated. [ 1261.085481] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a8e627c-dab5-44b7-8384-0678de165afe: rpc.has_security_group_logging(os_id): False [ 1261.103934] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.104253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.104253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.104445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.104486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.104701] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.104795] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.104862] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.105017] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.105108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.105209] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a8e627c-dab5-44b7-8384-0678de165afe is going to be created. [ 1261.107894] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.108077] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.108159] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.108324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.108451] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.118581] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d7c434-b719-4158-8390-2ca325980098 in Status: IN_PROGRESS for 2s [ 1261.247379] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.247470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.247505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.247728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.247817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.247916] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be updated. [ 1261.272450] env[66730]: INFO networking_nsxv3.common.synchronization [req-16912ac5-40b4-425f-96d2-fbfb3a0bc462 req-c4b8ab2d-189a-4ec7-8c10-945d323e12c1 service nova] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_rules [ 1261.272673] env[66730]: INFO networking_nsxv3.common.synchronization [req-16912ac5-40b4-425f-96d2-fbfb3a0bc462 req-c4b8ab2d-189a-4ec7-8c10-945d323e12c1 service nova] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1261.272806] env[66730]: INFO networking_nsxv3.common.synchronization [req-16912ac5-40b4-425f-96d2-fbfb3a0bc462 req-c4b8ab2d-189a-4ec7-8c10-945d323e12c1 service nova] Enqueued Resource ID: fa2e0390-c04b-440d-af52-48e99819b4d8 with Priority: HIGHEST for action port [ 1261.273474] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_rules [ 1261.275303] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1261.275383] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2e0390-c04b-440d-af52-48e99819b4d8 with Priority: HIGHEST for action port [ 1261.275671] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.275809] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.275876] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.276131] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.276214] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.277736] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.277829] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.278043] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa2e0390-c04b-440d-af52-48e99819b4d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.278148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa2e0390-c04b-440d-af52-48e99819b4d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.278211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa2e0390-c04b-440d-af52-48e99819b4d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.278388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa2e0390-c04b-440d-af52-48e99819b4d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.278473] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa2e0390-c04b-440d-af52-48e99819b4d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.289310] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.289513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.289513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.290053] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.290263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.301807] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.301807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.301807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.302462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.302462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.311618] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a8e627c-dab5-44b7-8384-0678de165afe in Status: IN_PROGRESS for 2s [ 1261.312547] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 1261.782031] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa2e0390-c04b-440d-af52-48e99819b4d8 with status ACTIVE [ 1261.782031] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.782031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.782031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.782031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.782031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.782528] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.782528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.782528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.782528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.782528] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.782673] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.782673] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.782740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.782860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.782908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.783032] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa2e0390-c04b-440d-af52-48e99819b4d8 is going to be updated. [ 1261.784198] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.784289] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.809618] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.809618] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.809745] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.809917] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.810082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.810259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa2e0390-c04b-440d-af52-48e99819b4d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.907953] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1261.908148] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d deletion is rescheduled due to dependency. [ 1261.908269] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.908476] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.908657] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.908844] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.908965] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.909039] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.909203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.909283] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.909379] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.033900] env[66730]: INFO networking_nsxv3.common.synchronization [None req-fd5794ef-0247-43fa-a647-1ace6678e7c9 tempest-AttachVolumeTestJSON-1280077890 tempest-AttachVolumeTestJSON-1280077890-project-member] Enqueued Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_rules [ 1262.034513] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_rules [ 1262.034846] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc111ca8-469a-4b4e-8809-edbda726f6d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.035081] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.035164] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.035859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.035978] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc111ca8-469a-4b4e-8809-edbda726f6d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.064187] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock network-758 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.064410] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "network-758" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.064553] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "network-758" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.064890] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "network-758" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.065591] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.065775] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.066152] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.066442] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.066600] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.066814] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1262.066927] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1262.067045] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1262.067154] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1262.067271] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1262.067479] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1262.067621] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1262.088064] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1262.088284] env[66730]: DEBUG dogpile.cache.region [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1262.088284] env[66730]: DEBUG dogpile.lock [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1262.088463] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "network-758" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.088799] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock port-266a3804-4eea-4ad9-a286-f49e5f8b701b taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.088987] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "port-266a3804-4eea-4ad9-a286-f49e5f8b701b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.089118] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "port-266a3804-4eea-4ad9-a286-f49e5f8b701b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.089468] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "port-266a3804-4eea-4ad9-a286-f49e5f8b701b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.089615] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('266a3804-4eea-4ad9-a286-f49e5f8b701b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.152814] env[66730]: INFO networking_nsxv3.common.synchronization [None req-86bea2e8-096e-4d45-9caf-bb40e9fdb5b3 tempest-AttachVolumeTestJSON-1280077890 tempest-AttachVolumeTestJSON-1280077890-project-member] Enqueued Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_rules [ 1262.153399] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_rules [ 1262.153744] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc111ca8-469a-4b4e-8809-edbda726f6d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.153847] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.413871] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.556943] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.557162] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.557270] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.557557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.557695] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.557909] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 already deleted. [ 1262.558066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.558259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.558494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.558612] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc111ca8-469a-4b4e-8809-edbda726f6d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.592352] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.592759] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.593016] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.593496] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.593748] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.594080] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Segment Port 266a3804-4eea-4ad9-a286-f49e5f8b701b not found, creating... [ 1262.594497] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.594740] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.594908] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.595318] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.595536] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.597666] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.597666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.597666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.597666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.597666] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.597666] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Resource: SegmentPort with ID: 266a3804-4eea-4ad9-a286-f49e5f8b701b is going to be created. [ 1262.620364] env[66730]: DEBUG networking_nsxv3.common.locking [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.620631] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.620814] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.621206] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.621522] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.621825] env[66730]: DEBUG oslo_concurrency.lockutils [None req-ca974e86-8ffc-432c-bb4f-bcead8fe6d72 None None] Releasing lock "port-266a3804-4eea-4ad9-a286-f49e5f8b701b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.916791] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.082832] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.082832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.082832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.082832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.082832] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.082832] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 already deleted. [ 1263.083399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.128180] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d7c434-b719-4158-8390-2ca325980098 in Status: SUCCESS [ 1263.128401] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d7c434-b719-4158-8390-2ca325980098 deletion is rescheduled due to dependency. [ 1263.128610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d7c434-b719-4158-8390-2ca325980098" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.335902] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 1263.336147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.336383] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.336634] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.336836] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.336957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.337034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.337198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.337280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.337366] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.337464] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.342132] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a8e627c-dab5-44b7-8384-0678de165afe in Status: SUCCESS [ 1263.342400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.359092] env[66730]: INFO networking_nsxv3.common.synchronization [req-16912ac5-40b4-425f-96d2-fbfb3a0bc462 req-6e3c4749-09fa-42fe-a196-fa94d39f1f34 service nova] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_rules [ 1263.359239] env[66730]: INFO networking_nsxv3.common.synchronization [req-16912ac5-40b4-425f-96d2-fbfb3a0bc462 req-6e3c4749-09fa-42fe-a196-fa94d39f1f34 service nova] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1263.359385] env[66730]: INFO networking_nsxv3.common.synchronization [req-16912ac5-40b4-425f-96d2-fbfb3a0bc462 req-6e3c4749-09fa-42fe-a196-fa94d39f1f34 service nova] Enqueued Resource ID: 266a3804-4eea-4ad9-a286-f49e5f8b701b with Priority: HIGHEST for action port [ 1263.360462] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_rules [ 1263.360616] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1263.360741] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 266a3804-4eea-4ad9-a286-f49e5f8b701b with Priority: HIGHEST for action port [ 1263.361148] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.361261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.361536] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.361877] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.362115] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-266a3804-4eea-4ad9-a286-f49e5f8b701b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.362232] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-266a3804-4eea-4ad9-a286-f49e5f8b701b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.362299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-266a3804-4eea-4ad9-a286-f49e5f8b701b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.363031] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-266a3804-4eea-4ad9-a286-f49e5f8b701b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.363031] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('266a3804-4eea-4ad9-a286-f49e5f8b701b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.419237] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.419467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.419467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.419703] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.419841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.419997] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1263.448883] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.449051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.449109] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.449368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.449594] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.458992] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1263.839622] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.867997] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 266a3804-4eea-4ad9-a286-f49e5f8b701b with status ACTIVE [ 1263.868405] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.868602] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.868668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.868883] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.868971] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.869168] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.869261] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.869319] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.869493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.869639] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.869774] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.869884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.869939] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.870080] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.870167] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.870253] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 266a3804-4eea-4ad9-a286-f49e5f8b701b is going to be updated. [ 1263.902538] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.902725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.902773] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.902989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.903133] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.903298] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-266a3804-4eea-4ad9-a286-f49e5f8b701b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.345204] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 395afc29-8cfd-45e2-9399-f1ce306e15d4: rpc.has_security_group_logging(os_id): False [ 1264.368817] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.368817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.368817] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.369066] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.369127] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.369545] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.369545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.369545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.369803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.369803] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.369803] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be updated. [ 1264.444777] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.444777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.444777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.444777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.444777] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.455613] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 1265.128886] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.129137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.129137] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.129368] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.129480] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.469804] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1265.470211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.470263] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.470553] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.470837] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.470995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.471079] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.471279] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.471380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.471500] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.632507] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.975141] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.135273] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.468665] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 1266.468921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.479137] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.638037] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1266.638142] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1266.983214] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.983584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.983710] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.984008] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.984158] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.984309] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1267.024332] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.024535] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.024643] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.024916] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.025118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.038202] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1267.521100] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.521637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.521637] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.521898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.547249] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1267.548545] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.549497] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1267.592305] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.592504] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.592588] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.592726] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.609543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.610484] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1267.610563] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1267.610654] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1267.665194] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.665349] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.665418] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.665647] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.667183] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.669935] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1267.759879] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.760024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.760123] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.760290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.760620] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.760942] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1267.844968] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.845198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.845198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.845441] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.845706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.846111] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1267.846208] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fb3e2980-ed0f-4c18-a149-cded1b258ec9', '3a8e627c-dab5-44b7-8384-0678de165afe', '5330f620-bc9e-4469-a7f3-c664f754a6e9', 'd435b8d7-20a4-46cb-ab34-d523daf07ab7', 'f152db72-4e1f-4942-b241-530ee83d9bd1', '8b9a7d35-62b1-4f86-8d97-51e115ac4c1d', '1fdb3ab9-9d8a-4975-a734-c0f1297bd452', 'f0031949-c54e-4110-961e-a682a87e628f', '086ea73c-820f-4794-8c0e-90c25aca8f44', '6a7c2214-9790-410b-aab0-021836529ff9', 'bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6', '74d582a7-b8c7-4980-ad04-779d4df3e481', '0af4fa83-97d6-42c2-b25a-f1300fa319d8', 'd9136fc3-4b03-47d5-a4a4-e9dafaa7acb5', '6dd73e9d-f53e-4682-9229-6fa30e9d8043', 'a5161856-541b-4ad9-a7f2-629e78702077', '400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0', '395afc29-8cfd-45e2-9399-f1ce306e15d4', '6ca41c1b-622d-4ab6-868b-84dca5e38456', '2aa77707-f5c7-48ed-9703-9e099c01463b', '9d40e47e-8889-4be5-a560-287881831b93', '11fac9ba-96d2-4dbb-99c3-f32131a3e0dc', 'b4155358-3708-4cf2-b2a6-fe099ab35896', '9ef57016-b424-4876-b955-b7af3e07c7c4', '94ea1b6a-f403-40f1-b3c2-7f52a8429c38', '90b245b6-5e49-420c-897d-4126cd8e7330', 'a42262f2-f569-4e53-9e7f-cce89b9f6ecb', '78eaf9ae-5f5d-4844-9951-fbe27a99cdad', '9ac62f82-b6ef-4c16-a3fd-c268cde0a17f', '90b73cdb-a74a-4eb6-9916-f76b4b7a65f9', 'a43e643f-8b52-4bbf-8dc6-b82fb3363343', 'ae31dacc-8242-4331-8786-1526682530bd', '0a55c2a9-6077-4f76-8e80-8d941329a6ba', '6c0b7262-514c-4f8f-99ae-f575f19b5ccd', 'cec4659b-96ff-48b6-ae37-82937d12179a', '7e4a2ee9-9ce1-46d2-900e-714dc4569d58', '2fcf4123-cafd-4d32-a572-25448d38c499', 'd6d7c434-b719-4158-8390-2ca325980098', '11cfe5ac-91a4-4528-906d-a180bf81f5e5', '3990207f-c264-4f81-b18d-55d8c1cd003e', 'a144e600-f0ab-4527-b46f-661bc4067c25', 'a985d046-799d-4d0f-ae02-11071c04b015', 'fa7a72f1-a5fe-42e4-ae80-d372c65a4ae0', '34c5c58e-4b22-4273-bd10-70b2a85bf96a'} {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1267.846307] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1267.870435] env[66730]: INFO networking_nsxv3.common.synchronization [req-d68a9d59-31e1-4775-a4df-860f02ad5e59 req-64ea4959-9278-47ba-be48-8491173cb538 tempest-AttachVolumeTestJSON-1280077890 tempest-AttachVolumeTestJSON-1280077890-project-member] Enqueued Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_members [ 1267.870435] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_members [ 1267.870435] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc111ca8-469a-4b4e-8809-edbda726f6d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.870435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.870435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.870435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.870435] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.870435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.870435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.870957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.870957] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.870957] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc111ca8-469a-4b4e-8809-edbda726f6d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.872677] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.873082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.873082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.873082] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.873255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.873255] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1267.873370] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1267.873370] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1267.963189] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.963652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.963863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.964200] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.965601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.966088] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1267.966283] env[66730]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66730) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1267.966447] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1267.968333] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1267.968333] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGH for action security_group_rules [ 1267.968333] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.302250] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.302445] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "network-130" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.302567] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "network-130" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.302911] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "network-130" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.303186] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.303340] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.303688] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.304384] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.304606] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.304908] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1268.305032] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] NeedRegenerationException {{(pid=66730) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1268.305147] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] no value, waiting for create lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1268.305251] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] value creation lock acquired {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1268.305357] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] No value present for key: 'zone-id' {{(pid=66730) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1268.305460] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Calling creation function for not-yet-present value {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1268.305588] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1268.325063] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1268.325259] env[66730]: DEBUG dogpile.cache.region [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66730) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1268.325393] env[66730]: DEBUG dogpile.lock [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Released creation lock {{(pid=66730) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1268.325559] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "network-130" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.325867] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock port-47c50786-243a-425e-ba9c-84c8e78e4cdd taken with stack trace [, , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.326042] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "port-47c50786-243a-425e-ba9c-84c8e78e4cdd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.326159] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "port-47c50786-243a-425e-ba9c-84c8e78e4cdd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.326473] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "port-47c50786-243a-425e-ba9c-84c8e78e4cdd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.326617] env[66730]: DEBUG networking_nsxv3.api.rpc [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47c50786-243a-425e-ba9c-84c8e78e4cdd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.376471] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.376633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.376678] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.377274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.377274] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.377502] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.377681] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.377792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.378134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.378275] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.378376] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 already deleted. [ 1268.378469] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.829564] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.830055] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.830055] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.830137] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.830248] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.830402] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Segment Port 47c50786-243a-425e-ba9c-84c8e78e4cdd not found, creating... [ 1268.830659] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.830813] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.830928] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.831167] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.831298] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.831574] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.831725] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.831837] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.832069] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.832214] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.832350] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Resource: SegmentPort with ID: 47c50786-243a-425e-ba9c-84c8e78e4cdd is going to be created. [ 1268.853216] env[66730]: DEBUG networking_nsxv3.common.locking [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.853462] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.853637] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.853909] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.854144] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.854359] env[66730]: DEBUG oslo_concurrency.lockutils [None req-cb275b60-a7c9-4939-a7a5-78f58bb04048 None None] Releasing lock "port-47c50786-243a-425e-ba9c-84c8e78e4cdd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.049992] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1269.050163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.050290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.050510] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.050718] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.050928] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.050983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.051144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.051254] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.051301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.051445] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.052463] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.052630] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.053599] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.053599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.053599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.053599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.053599] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.053599] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.543894] env[66730]: INFO networking_nsxv3.common.synchronization [req-d68a9d59-31e1-4775-a4df-860f02ad5e59 req-41fdc645-1a25-416b-b1c0-be5b3f0610c3 service nova] Enqueued Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_rules [ 1269.543894] env[66730]: INFO networking_nsxv3.common.synchronization [req-d68a9d59-31e1-4775-a4df-860f02ad5e59 req-41fdc645-1a25-416b-b1c0-be5b3f0610c3 service nova] Enqueued Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_members [ 1269.543894] env[66730]: INFO networking_nsxv3.common.synchronization [req-d68a9d59-31e1-4775-a4df-860f02ad5e59 req-41fdc645-1a25-416b-b1c0-be5b3f0610c3 service nova] Enqueued Resource ID: 47c50786-243a-425e-ba9c-84c8e78e4cdd with Priority: HIGHEST for action port [ 1269.544603] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_rules [ 1269.544807] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_members [ 1269.545359] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47c50786-243a-425e-ba9c-84c8e78e4cdd with Priority: HIGHEST for action port [ 1269.545359] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 with Priority: HIGH for action security_group_rules [ 1269.545359] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 with Priority: HIGH for action security_group_rules [ 1269.545359] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 with Priority: HIGH for action security_group_rules [ 1269.545676] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 with Priority: HIGH for action security_group_rules [ 1269.545676] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa77707-f5c7-48ed-9703-9e099c01463b with Priority: HIGH for action security_group_rules [ 1269.545676] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 with Priority: HIGH for action security_group_rules [ 1269.545848] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGH for action security_group_rules [ 1269.545848] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 with Priority: HIGH for action security_group_rules [ 1269.545965] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 with Priority: HIGH for action security_group_rules [ 1269.546109] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5161856-541b-4ad9-a7f2-629e78702077 with Priority: HIGH for action security_group_rules [ 1269.546172] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 with Priority: HIGH for action security_group_rules [ 1269.546295] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 with Priority: HIGH for action security_group_rules [ 1269.546409] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 with Priority: HIGH for action security_group_rules [ 1269.546531] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a7c2214-9790-410b-aab0-021836529ff9 with Priority: HIGH for action security_group_rules [ 1269.546649] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 with Priority: HIGH for action security_group_rules [ 1269.546762] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGH for action security_group_rules [ 1269.546875] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0031949-c54e-4110-961e-a682a87e628f with Priority: HIGH for action security_group_rules [ 1269.546992] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f152db72-4e1f-4942-b241-530ee83d9bd1 with Priority: HIGH for action security_group_rules [ 1269.547144] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGH for action security_group_rules [ 1269.547218] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 with Priority: HIGH for action security_group_rules [ 1269.547596] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc111ca8-469a-4b4e-8809-edbda726f6d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.547749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.547828] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.548108] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.548206] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc111ca8-469a-4b4e-8809-edbda726f6d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.549888] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc111ca8-469a-4b4e-8809-edbda726f6d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.550020] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.550213] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.550455] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.550656] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.550807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.550879] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.551147] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.551264] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.551379] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc111ca8-469a-4b4e-8809-edbda726f6d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.553161] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock port-47c50786-243a-425e-ba9c-84c8e78e4cdd taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.553351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47c50786-243a-425e-ba9c-84c8e78e4cdd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.553496] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47c50786-243a-425e-ba9c-84c8e78e4cdd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.553711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47c50786-243a-425e-ba9c-84c8e78e4cdd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.553826] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47c50786-243a-425e-ba9c-84c8e78e4cdd',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.555164] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.555341] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.555461] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.555574] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.555696] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3e2980-ed0f-4c18-a149-cded1b258ec9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.556786] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5330f620-bc9e-4469-a7f3-c664f754a6e9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.556950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.557065] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.557259] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.557349] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5330f620-bc9e-4469-a7f3-c664f754a6e9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.558383] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.558754] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.558853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.559046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.559166] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fdb3ab9-9d8a-4975-a734-c0f1297bd452',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.560193] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.560329] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.560410] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.560905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.560983] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd73e9d-f53e-4682-9229-6fa30e9d8043',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.561825] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aa77707-f5c7-48ed-9703-9e099c01463b taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.563021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.563021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.563021] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.563021] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aa77707-f5c7-48ed-9703-9e099c01463b',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.563742] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ca41c1b-622d-4ab6-868b-84dca5e38456 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.563880] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.563954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.564150] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.564238] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ca41c1b-622d-4ab6-868b-84dca5e38456',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.565089] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.565212] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.565307] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.565623] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.565623] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.569389] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.569389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.569614] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.569677] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.569780] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.571238] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.571351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.571985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.571985] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.571985] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.574116] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5161856-541b-4ad9-a7f2-629e78702077 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.574116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.574116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.574116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.574116] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5161856-541b-4ad9-a7f2-629e78702077',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.575053] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.575136] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.575386] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.575438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.575513] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af4fa83-97d6-42c2-b25a-f1300fa319d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.577623] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74d582a7-b8c7-4980-ad04-779d4df3e481 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.577766] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.577886] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.578569] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.578913] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74d582a7-b8c7-4980-ad04-779d4df3e481',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.580782] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.580887] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.580977] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.581198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.581294] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.582418] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a7c2214-9790-410b-aab0-021836529ff9 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.582559] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.582648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.582864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.582970] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a7c2214-9790-410b-aab0-021836529ff9',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.583841] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-086ea73c-820f-4794-8c0e-90c25aca8f44 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.583972] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.584480] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.584701] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.585226] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('086ea73c-820f-4794-8c0e-90c25aca8f44',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.586024] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.586024] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.586144] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0031949-c54e-4110-961e-a682a87e628f taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.586301] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.586351] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.586509] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.586619] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0031949-c54e-4110-961e-a682a87e628f',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.586995] env[66730]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1269.587805] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f152db72-4e1f-4942-b241-530ee83d9bd1 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.587950] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.588051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.588262] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.589110] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f152db72-4e1f-4942-b241-530ee83d9bd1',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.589514] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a8e627c-dab5-44b7-8384-0678de165afe taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.589680] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.589759] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.590246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.590357] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.591869] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.592007] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.592856] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.592984] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.593094] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d435b8d7-20a4-46cb-ab34-d523daf07ab7',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.599039] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47c50786-243a-425e-ba9c-84c8e78e4cdd with status ACTIVE [ 1269.599124] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.599477] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.599570] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.599878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.599959] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.600341] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.600497] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.600589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.600775] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.600878] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.601135] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.601253] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.601338] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.601793] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.601908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.602030] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47c50786-243a-425e-ba9c-84c8e78e4cdd is going to be updated. [ 1269.605496] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.605648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.605824] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.633262] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.633468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.633468] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.633711] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.636741] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.636889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.636962] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.637116] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.637255] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.637399] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47c50786-243a-425e-ba9c-84c8e78e4cdd" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.655517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.655647] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5330f620-bc9e-4469-a7f3-c664f754a6e9 is going to be deleted. [ 1269.765119] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.765342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.765342] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.765538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.765754] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.765754] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5330f620-bc9e-4469-a7f3-c664f754a6e9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.050479] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc111ca8-469a-4b4e-8809-edbda726f6d8 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.050859] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.054081] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc111ca8-469a-4b4e-8809-edbda726f6d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.098912] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.099154] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.099219] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.099417] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.099580] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.099708] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.099772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.099918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.100034] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.100105] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.100194] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.103516] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.103516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.103516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.103516] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.106552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.106683] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.107335] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.107427] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.108653] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.108653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.111528] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a8e627c-dab5-44b7-8384-0678de165afe taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.111650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.111706] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.111889] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.112039] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.112134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.112193] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.112343] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.112423] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.112505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.112583] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.117959] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.118091] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.119425] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.121387] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.154853] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.154853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.155915] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.155915] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.156897] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.157029] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.158084] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.158201] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af4fa83-97d6-42c2-b25a-f1300fa319d8 is going to be deleted. [ 1270.159596] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.159702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.159740] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.159943] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.161428] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.161543] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.162423] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.162519] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.163220] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.163324] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.164137] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.164248] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.164960] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.165078] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.165757] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.165853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.166552] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.166648] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.185730] env[66730]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1270.186312] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.186665] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aa77707-f5c7-48ed-9703-9e099c01463b is going to be deleted. [ 1270.187687] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.187905] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.208786] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.208962] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5 is going to be deleted. [ 1270.209792] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.210085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.261359] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.261660] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0 is going to be deleted. [ 1270.262652] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.262933] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.264603] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.264807] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.265561] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.265661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.296816] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.296968] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74d582a7-b8c7-4980-ad04-779d4df3e481 is going to be deleted. [ 1270.297976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.298182] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.310745] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.310921] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.318513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.318653] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd73e9d-f53e-4682-9229-6fa30e9d8043 is going to be deleted. [ 1270.319560] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.319834] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.375601] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.375601] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.380689] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.380841] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.398048] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.398048] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 086ea73c-820f-4794-8c0e-90c25aca8f44 is going to be deleted. [ 1270.398613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.398842] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.468172] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.468357] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0031949-c54e-4110-961e-a682a87e628f is going to be deleted. [ 1270.469350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.469580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.499149] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.499339] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.513181] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.513421] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.520429] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.520623] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3e2980-ed0f-4c18-a149-cded1b258ec9 is going to be deleted. [ 1270.521470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.521824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.558770] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc111ca8-469a-4b4e-8809-edbda726f6d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.580851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.581067] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5161856-541b-4ad9-a7f2-629e78702077 is going to be deleted. [ 1270.582070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.582317] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.619403] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.627675] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 395afc29-8cfd-45e2-9399-f1ce306e15d4: rpc.has_security_group_logging(os_id): False [ 1270.628896] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.629074] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.629145] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.629350] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.629438] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.629534] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1270.695514] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.695684] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a7c2214-9790-410b-aab0-021836529ff9 is going to be deleted. [ 1270.696717] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.696976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.722606] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.722772] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.727436] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.727651] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.735382] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.735585] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.737567] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.737752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.737752] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.737979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.738134] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.739981] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.740085] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d435b8d7-20a4-46cb-ab34-d523daf07ab7 is going to be deleted. [ 1270.741336] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.741536] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.749518] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.749749] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.758653] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1270.791216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.791282] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f152db72-4e1f-4942-b241-530ee83d9bd1 is going to be deleted. [ 1270.792250] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.792470] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.874725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.874725] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ca41c1b-622d-4ab6-868b-84dca5e38456 is going to be deleted. [ 1270.875644] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.875919] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.914309] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.914309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.917161] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.917161] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.925086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.925283] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fdb3ab9-9d8a-4975-a734-c0f1297bd452 is going to be deleted. [ 1270.926238] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.926493] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.940570] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.940800] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.999671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.999916] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6 is going to be deleted. [ 1271.000835] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.001083] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.001180] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.001309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aa77707-f5c7-48ed-9703-9e099c01463b" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.001484] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.001653] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.001734] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.001864] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af4fa83-97d6-42c2-b25a-f1300fa319d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.002488] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.002668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.002747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.002865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9136fc3-4b03-47d5-a4a4-e9dafaa7acb5" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.003009] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.003203] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.003280] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.003396] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74d582a7-b8c7-4980-ad04-779d4df3e481" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.003578] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.003728] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.003805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.003976] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400a7d5e-1b43-4bea-8fe9-5a06cba5c7a0" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.004163] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.004330] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.004445] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.004610] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd73e9d-f53e-4682-9229-6fa30e9d8043" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.004787] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.004951] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.005049] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.005166] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-086ea73c-820f-4794-8c0e-90c25aca8f44" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.005292] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.005439] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.005506] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.005619] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0031949-c54e-4110-961e-a682a87e628f" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.005747] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.005914] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.060977] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.061464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.061464] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.061584] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.062632] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.062632] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 is going to be created. [ 1271.121787] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a8e627c-dab5-44b7-8384-0678de165afe: rpc.has_security_group_logging(os_id): False [ 1271.129203] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.129286] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.143167] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.143411] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.161272] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.161599] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.161804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.161804] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.162051] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.162352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.162482] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be updated. [ 1271.163765] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.163954] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.164092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.164165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3e2980-ed0f-4c18-a149-cded1b258ec9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.164297] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.164487] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.164628] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.164723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5161856-541b-4ad9-a7f2-629e78702077" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.166999] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.167246] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.167334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.167633] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.167899] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.169494] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.169757] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.169891] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.170089] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a7c2214-9790-410b-aab0-021836529ff9" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.170299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.170538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.170667] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.170860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d435b8d7-20a4-46cb-ab34-d523daf07ab7" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.172176] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.172380] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.172511] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.172774] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.198957] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 in Status: UNINITIALIZED for 2s [ 1271.213208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.213678] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.213863] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.213968] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.214227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.214419] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.214419] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a8e627c-dab5-44b7-8384-0678de165afe is going to be updated. [ 1271.216408] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.216660] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.216771] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.216892] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fdb3ab9-9d8a-4975-a734-c0f1297bd452" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.217040] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.217216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.217290] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.217397] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f152db72-4e1f-4942-b241-530ee83d9bd1" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.217554] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.217699] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.217776] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.217884] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ca41c1b-622d-4ab6-868b-84dca5e38456" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.232320] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.232558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.232558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.232730] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.232833] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.232967] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf6c4d96-d8f1-46cd-b6a6-f9500a2de4f6" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.358678] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.358983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.358983] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.359146] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.359201] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.380018] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 1271.439134] env[66730]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1271.439924] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.440118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.440216] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.440527] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.440725] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.475907] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a8e627c-dab5-44b7-8384-0678de165afe in Status: IN_PROGRESS for 2s [ 1272.768809] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1272.769085] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.769215] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.769435] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.769627] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.769750] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.769818] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.769979] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.770075] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.770160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.770318] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.770414] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.770525] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.770617] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.770757] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.770857] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.770918] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.771070] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.771144] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.771223] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.771313] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.210560] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 in Status: SUCCESS [ 1273.210873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.211055] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.211278] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.211476] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.211609] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.211675] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.211844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.211925] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.212014] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.212132] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc111ca8-469a-4b4e-8809-edbda726f6d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.274425] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d: rpc.has_security_group_logging(os_id): False [ 1273.294034] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.294185] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.294260] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.294505] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.322299] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.322299] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.322549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.322549] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.322641] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.323836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.323836] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.323836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.323836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.323836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.323836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.323836] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.323836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.323836] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.324251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.324251] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.324251] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1273.398933] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 1273.399233] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.443725] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.443974] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.443974] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.444311] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.444489] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.461959] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1273.492871] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a8e627c-dab5-44b7-8384-0678de165afe in Status: SUCCESS [ 1273.493118] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.713982] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc111ca8-469a-4b4e-8809-edbda726f6d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.217262] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc111ca8-469a-4b4e-8809-edbda726f6d8: rpc.has_security_group_logging(os_id): False [ 1274.240100] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.240372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.240372] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.240530] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.240593] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.240827] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.240913] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.240966] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.241152] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.241271] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.241407] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 is going to be created. [ 1274.311937] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.312148] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.312199] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.312389] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.312604] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.327796] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 in Status: IN_PROGRESS for 2s [ 1274.548710] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.548883] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1274.602532] env[66730]: INFO networking_nsxv3.common.synchronization [req-28fcc73c-923f-4ba7-b7cd-842efdebb4ce req-a669525f-f0d5-4b54-8aa7-df2c921f651c tempest-ServersTestMultiNic-1862728566 tempest-ServersTestMultiNic-1862728566-project-member] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1274.602532] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1274.602532] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.602532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.602532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.602532] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.602768] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.602811] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.602846] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.602995] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.603092] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.603189] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.786400] env[66730]: INFO networking_nsxv3.common.synchronization [req-28fcc73c-923f-4ba7-b7cd-842efdebb4ce req-71c10c71-d1fc-4e13-b4ff-d8d340426e1c tempest-ServersTestMultiNic-1862728566 tempest-ServersTestMultiNic-1862728566-project-member] Enqueued Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1274.786924] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d with Priority: HIGHEST for action security_group_members [ 1274.787785] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.787785] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.105715] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.479286] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1275.479723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.479723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.479994] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.480098] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.607848] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.000007] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.000169] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.000236] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.000449] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.000690] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.000690] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be deleted. [ 1276.048845] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.049030] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.049076] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.049284] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.049374] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.049517] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.049682] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.049922] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.050063] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.110998] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.111208] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.111273] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.111557] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.111650] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.111750] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be updated. [ 1276.153650] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.153865] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.153989] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.154309] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.154467] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.164170] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: IN_PROGRESS for 2s [ 1276.345452] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 in Status: SUCCESS [ 1276.345671] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.569681] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.570063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.570063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.570143] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.570198] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.570294] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d already deleted. [ 1276.570379] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.174495] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d in Status: SUCCESS [ 1278.174851] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.174907] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.175140] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.175513] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.175513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.175513] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.175723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.175723] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.175806] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9a7d35-62b1-4f86-8d97-51e115ac4c1d',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.678027] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.678211] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.678320] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.678492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.678580] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.678785] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.678873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.678942] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.679100] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.679176] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.679261] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9a7d35-62b1-4f86-8d97-51e115ac4c1d is going to be deleted. [ 1278.735585] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.735805] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.735873] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.736249] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.736388] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.736538] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9a7d35-62b1-4f86-8d97-51e115ac4c1d" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.789140] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.789542] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1284.790403] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.790697] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1289.792067] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.792464] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1294.793159] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1294.793580] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1299.794423] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.794854] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1304.795527] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1304.796052] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1309.796939] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1309.797331] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1314.798134] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.798134] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1317.350523] env[66730]: INFO networking_nsxv3.common.synchronization [req-a43d4d23-c2aa-4f13-abac-fa6111a750f7 req-08640509-eb9c-4527-b869-3f957b4c478f tempest-ServerActionsTestJSON-130950099 tempest-ServerActionsTestJSON-130950099-project-member] Enqueued Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1317.351317] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 with Priority: HIGHEST for action security_group_members [ 1317.351761] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-395afc29-8cfd-45e2-9399-f1ce306e15d4 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.352086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.352086] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.352377] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.352646] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.352824] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.352944] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.353217] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.353361] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.353511] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395afc29-8cfd-45e2-9399-f1ce306e15d4',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.855697] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.855908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.855908] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.856173] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.856291] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.856501] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.856603] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.856661] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.856822] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.856898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.856984] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 is going to be updated. [ 1317.886642] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.886860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.886860] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.887045] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.887187] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.896212] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: IN_PROGRESS for 2s [ 1319.906467] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 in Status: SUCCESS [ 1319.906755] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395afc29-8cfd-45e2-9399-f1ce306e15d4 deletion is rescheduled due to dependency. [ 1319.906755] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395afc29-8cfd-45e2-9399-f1ce306e15d4" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.351870] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.352206] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.352788] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.353210] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.353891] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1332.354351] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1337.355310] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1337.355672] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.356741] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.357019] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1347.358498] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.358884] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.126436] env[66730]: INFO networking_nsxv3.common.synchronization [req-5a4e3dd3-fb44-49d0-ab7f-a279106f5b27 req-ba15a97c-b84c-4644-a982-d59354f67a60 tempest-AttachVolumeTestJSON-1280077890 tempest-AttachVolumeTestJSON-1280077890-project-member] Enqueued Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_members [ 1348.126979] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 with Priority: HIGHEST for action security_group_members [ 1348.127276] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc111ca8-469a-4b4e-8809-edbda726f6d8 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.127447] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.127492] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.127702] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.127853] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.127978] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.128046] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.128385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.128385] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.128385] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc111ca8-469a-4b4e-8809-edbda726f6d8',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.630959] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.631400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.631400] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.631486] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.631522] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.631709] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.631808] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.631868] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.632036] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.632115] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.632234] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 is going to be updated. [ 1348.662099] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.662331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.662331] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.662531] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.662668] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.671182] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 in Status: IN_PROGRESS for 2s [ 1350.681967] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 in Status: SUCCESS [ 1350.682402] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc111ca8-469a-4b4e-8809-edbda726f6d8 deletion is rescheduled due to dependency. [ 1350.682402] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc111ca8-469a-4b4e-8809-edbda726f6d8" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.127889] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.128181] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.130044] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.130044] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1363.131149] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.131457] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.812532] env[66730]: INFO networking_nsxv3.common.synchronization [req-a0287f07-a798-4e0e-aa9e-9d357226aad5 req-c6af3330-6fe9-4e33-8b4c-e239428a512a tempest-ServerRescueNegativeTestJSON-2058866044 tempest-ServerRescueNegativeTestJSON-2058866044-project-member] Enqueued Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_members [ 1366.813107] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a8e627c-dab5-44b7-8384-0678de165afe with Priority: HIGHEST for action security_group_members [ 1366.813559] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a8e627c-dab5-44b7-8384-0678de165afe taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.813779] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.813853] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.814060] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.814232] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.814334] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.814392] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.814705] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.815103] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.815103] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a8e627c-dab5-44b7-8384-0678de165afe',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.317430] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.317642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.317642] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.317909] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.318054] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.318295] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.318426] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.318523] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.318719] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.318850] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.318969] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a8e627c-dab5-44b7-8384-0678de165afe is going to be updated. [ 1367.346468] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.346613] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.346710] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.346924] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.347090] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.356776] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a8e627c-dab5-44b7-8384-0678de165afe in Status: IN_PROGRESS for 2s [ 1369.368056] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a8e627c-dab5-44b7-8384-0678de165afe in Status: SUCCESS [ 1369.368056] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a8e627c-dab5-44b7-8384-0678de165afe deletion is rescheduled due to dependency. [ 1369.368462] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a8e627c-dab5-44b7-8384-0678de165afe" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.814400] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.814703] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.815609] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.815938] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.001502] env[66730]: INFO networking_nsxv3.common.synchronization [req-a6514ca1-fa53-4318-9a48-c878c4abe2d8 req-423afed8-d43b-4e7b-a427-5f52fafc648c tempest-ServerRescueNegativeTestJSON-2058866044 tempest-ServerRescueNegativeTestJSON-2058866044-project-member] Enqueued Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1377.001502] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1377.001502] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.001502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.001502] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.001970] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.002264] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.003844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.003844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.003844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.003844] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.003844] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.505879] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.008020] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.511134] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.511391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.511391] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.511589] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.511684] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.511784] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fcf4123-cafd-4d32-a572-25448d38c499 is going to be updated. [ 1378.544352] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.544352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.544352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.544352] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.544537] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.553269] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: IN_PROGRESS for 2s [ 1380.564903] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: SUCCESS [ 1380.565276] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.001811] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.002312] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.697567] env[66730]: INFO networking_nsxv3.common.synchronization [req-f1d074a5-2709-43ef-846f-9cb9b9d7f931 req-6672931b-28d4-42fa-aec7-92d8424911d4 tempest-ServerRescueNegativeTestJSON-2058866044 tempest-ServerRescueNegativeTestJSON-2058866044-project-member] Enqueued Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1383.698131] env[66730]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fcf4123-cafd-4d32-a572-25448d38c499 with Priority: HIGHEST for action security_group_members [ 1383.698439] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fcf4123-cafd-4d32-a572-25448d38c499 taken with stack trace [, , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.698558] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.698624] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.698898] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.699064] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.699165] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.699227] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.699373] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.699457] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.699547] env[66730]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fcf4123-cafd-4d32-a572-25448d38c499',) {} {{(pid=66730) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.203063] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.203063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.203063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.203063] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.224443] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.224723] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.225096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.225096] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.225183] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.225218] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.225283] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fcf4123-cafd-4d32-a572-25448d38c499 is going to be updated. [ 1384.257591] env[66730]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66730) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.257814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.257814] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.258011] env[66730]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.258160] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.267900] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: IN_PROGRESS for 2s [ 1386.279098] env[66730]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fcf4123-cafd-4d32-a572-25448d38c499 in Status: SUCCESS [ 1386.279566] env[66730]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fcf4123-cafd-4d32-a572-25448d38c499 deletion is rescheduled due to dependency. [ 1386.279566] env[66730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fcf4123-cafd-4d32-a572-25448d38c499" {{(pid=66730) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.698910] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.699271] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.700254] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.700607] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.701357] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.701670] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.702532] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.702912] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.703545] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.703850] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.704648] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.705064] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.705981] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.706332] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.707661] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.708067] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.708667] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.708969] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.709397] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.709779] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.710834] env[66730]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.711213] env[66730]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0